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THE  REASON  FOR  PERFORMING  THE  STUDY  is  to  validate  and  enhance  the  rules 
for  command  and  control  (C'd)  decisionmaking  in  the  Force  Evaluation  Model 
(FORCEM).  FORCEM  is  a  fully  automated  computer  model  of  combat,  combat 
support,  and  combat  service  support  (CSS)  in  a  theater.  C?  is  treated 
through  a  set  of  decisions,  each  represented  through  embedded  rules  which 
in  turn  reference  preselected  information  from  the  perception  data  base. 

THE  PRINCIPAL  FINDINGS  OF  THE  STUDY  are: 

(1)  The  approach  used  in  this  study  provides  a  valuable  tool  for  devel¬ 
oping  or  revising  decision  rules. 

(2)  The  perception  data  base  variables  used  in  the  rules  currently  in 
FORCEM  are  relevant  to  the  decisions. 

(3)  Several  additional  variables  are  suggested  for  incorporation  in  the 
FORCEM  perception  data  base,  for  possible  use  as  criteria  for  making 
decisions. 

(4)  For  several  decisions,  existing  perception  data  base  variables  are 
suggested  for  use  as  decision  criteria,  over  and  above  the  variables  used 
in  the  rules  currently  in  FORCEM. 

(5)  Data  are  obtained  that  can  be  used  to  adjust  the  rules  currently  in 
FORCEM  to  better  reflect  the  views  of  the  subjects  queried  in  the  study. 

(6)  The  techniques  for  gathering  data  for  this  study  yield  starting 
points  for  methods  to  record  decision  processes  of  gamers  for  FORGE,  an 
interruptible  wargame  based  on  FORCEM.  Due  to  the  schedule  for  development 
of  FORGE,  and  the  constraint  on  time  for  this  study,  no  further  consider¬ 
ation  was  given  to  FORGE. 

THE  MAIN  ASSUMPTION  is  that  FORCEM  provides  an  adequate  contex*  for  examin- 
imfC?  issues  at  echelons  above  division. 

THE  PRINCIPAL  LIMITATION  is  that  the  study  is  limited  to  the  "Blue" 
perspective;  i.e.,  that  of  the  US  and  its  allies. 

THE  SCOPE  OF  THE  STUDY  is  the  following  set  of  decisions  the  r^RCEv 

module: 


[/?-/ 


(I)  Assignment  of  new  corps. 

(?)  Assignment  of  new  division. 


(3)  Assignment  of  new  field  artillery  battalion. 

(4)  Designation  of  posture  of  online  corps. 

(5)  Specification  of  priority  to  corps  for  close  air  support  (CAS). 

(6)  Specification  of  priority  to  corps  for  CSS. 

(7)  Specification  of  priority  to  division  for  CAS. 

(3)  Specification  of  priority  to  division  for  CSS. 

THE  STUDY  OBJECTIVES  were  to: 


(1)  Develop  and  apply  methodologies  to: 

(a)  Examine  specific  decisions  using  scenarios  extracted  from  FORCEM 
or  FORGE,  including  selected  data  from  the  perception  data  base  and  graphics 
displays. 


(b)  Prepare  and  exercise  "offline"  experiments  based  on  the  scenarios, 
and 


(c)  Apply  the  information  collected  from  the  experiments  to  validate 
and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies  for 
use  during  the  actual  exercise  of  FORGE. 

(2)  Develop  methodologies  to: 

(a)  Record  gamer  decision  processes  during  the  exercise  of  FORGE,  and 

(b)  Use  the  information  collected  from  gamers  to  validate  and  enhance 
the  decision  rules  in  FORCEM. 


(3)  Make  recommendations  for  actual  exercises  of  FORGE. 

THE  BASIC  APPROACH  was  to  design  "offline"  experiments  based  on  the  selected 
decisions,  administer  the  experiments  to  groups  of  students  at  the  US  Army 
War  College,  and  apply  statistical  analysis  to  the  results  of  the  experi¬ 
ments.  Additional  information  was  collected  through  a  post-experiment 
questi onnai re. 

THE  STUDY  SPONSOR  was  the  Director,  US  Army  Concepts  Analysis  Agency. 

THE  STUDY  EFFORT  was  directed  by  Dr.  James  J.  Metzger,  Forces  Directorate, 

US  Army  Concepts  Analysis  Agency. 

COfUENTS  AND  QUESTIONS  may  be  directed  to  the  Director,  US  Army  Concepts 
Analysis  Agency,  ATTN:  CSCA-FOF,  3120  Woodmont  Avenue,  Bethesda,  MD, 
20314-2797. 


Tear-out  copies  of  tnis  synopsis  are  at  pack  cover. 
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CO^ND  AND  CONTROL  (C2)  ENHANCEMENTS  FOR  FORCEM 

CHAPTER  1 
EXECUTIVE  SUMMARY 


1-1.  PROBLEM.  The  problem  is  to  validate  and  enhance  the  rules  for  command 
and  control  (C2)  decisionmaking  in  the  fully  automated  Force  Evaluation 
Model  (FORCEM)  through  the  structured  application  of  military  expertise  and 
statistical  analysis. 

1-2.  BACKGROUND 

a.  FORCEM  is  a  fully  automated  computer  model  that  simulates  combat, 
combat  support,  and  combat  service  support  (CSS)  in  a  theater.  C2  decision¬ 
making  is  represented  at  headquarters  units  at  three  echelons--theater , 
army,  and  corps  (in  US  terminology).  C2  is  treated  through  a  set  of  deci¬ 
sions,  each  represented  through  embedded  rules  which  in  turn  reference  pre¬ 
selected  information  from  the  perception  data  base  (an  internal  data  base 
containing  information  known  to  headquarters  units  making  the  decisions). 

The  user  has  limited  control  through  the  designation  of  threshold  values  to 
which  the  variables  from  the  perception  data  base  are  compared  in  the  rules. 

b.  The  FORCEM  Gaming  Evaluator  (FORGE)  is  an  interruptible  wargame  based 
on  FORCEM.  It  allows  gamers  to  make  the  key  decisions  at  the  theater  and 
army  echelons.  In  making  such  decisions,  the  gamers  have  available  the 
information  in  the  perception  data  base  (not  just  the  data  used  in  the  rules 
embedded  in  FORCEM)  plus  graphics  displays  of  the  battlefield. 

c.  Military  expertise  can  be  brought  to  bear  to  validate  and  enhance 
the  decision  rules  in  FORCEM.  This  can  be  accomplished  by  using  "offline" 
experiments  (question  sessions  using  human  subjects  as  decisionmakers)  based 
on  FORCEM  or  FORGE  scenarios,  or  by  using  FORGE  itself. 

1-3.  PURPOSE  AND  OBJECTIVES.  The  purpose  of  the  study  is  to  validate  and 
enhance  the  decision  rules  in  FORCEM.  The  objectives  are  to: 

a.  Develop  and  apply  methodologies  to: 

(1)  Examine  specific  decisions  using  scenarios  extracted  from  FORCEM 
or  FORGE,  including  selected  data  from  the  perception  data  base  and  graphics 
di spl ays, 

(2)  Prepare  and  exercise  "offline"  experiments  based  n  the  scenarios, 
and 

(3)  Apply  the  information  collected  from  the  experiments  to  validate 
and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies  for 
use  during  the  actual  exercise  of  FORGE. 
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b.  Develop  methodologies  to: 

(1)  Record  gamer  decision  processes  during  the  exercise  of  FORGE,  and 

(2)  Use  the  information  collected  from  gamers  to  validate  and  enhance 
the  decision  rules  in  FORCEM. 

c.  Make  recommendations  for  actual  exercises  of  FORGE  using  the  method¬ 
ologies  of  paragraph  l-3b  above. 

1-4.  SCOPE.  The  decisions  selected  for  experimentation  are  shown  in 
Table  1-1.  The  numbering  of  decisions  is  for  reference  in  this  report  only 


Table  1-1.  FORCEM  Decisions  Considered  in  Study 


Number 
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1-6.  TIMEFRAME.  This  is  a  methodology  study;  hence  timeframe  is  not 
cri tical . 

1-7.  ASSIMPTION.  FORCEM  provides  an  adequate  context  for  examining 
issues  at  echelons  above  division. 

1-8.  STUDY  APPROACH  AND  METHODOLOGY.  The  primary  approach  is  to  develop 
and  apply  statistical  experiments  for  the  decisions  shown  in  Table  1-1. 

For  each  such  decision,  an  "offline"  experiment  is  designed  wherein  the 
perception  data  base  variables  (used  in  the  rules  currently  in  FORCEM)  are 
controlled  and  varied.  For  each  case  (with  a  value  assigned  to  each  percep¬ 
tion  data  base  variable),  the  subject  is  asked  what  the  decision  should  be. 
Each  experiment  (one  decision,  a  number  of  cases)  is  administered  to  a  group 
of  subjects.  Statistical  analysis  is  applied  to  the  experimental  data  to 
develop  mean  values  and  prediction  equations,  and  then  to  compare  the 
results  to  the  rules  currently  in  FORCEM.  Several  other  approaches  provid¬ 
ing  useful  data  for  the  study  are  described  in  Chapter  2. 

1-9.  ESSENTIAL  ELEMENTS  OF  ANALYSIS 

a.  Are  the  decisions  currently  represented  in  FORCEM  appropriate  for 
a  theater- level  model? 

This  question  is  not  addressed  directly.  Each  subject  considers  one  (or  at 
most,  a  few)  of  the  FORCEM  decisions,  so  that  a  comprehensive  view  of  the 
full  suite  of  decisions  is  not  possible.  However,  based  on  written  comments 
by  several  subjects,  and  on  opinions  gathered  previously  by  the  director  of 
this  study,  the  following  can  be  stated:  Generally,  the  major  categories 
of  FORCEM  deci sions--resource  allocation,  maneuver  control,  and  interface 
with  the  other  functional  areas--are  acceptable.  Some  of  the  specific  decis¬ 
ions  are  immediately  acceptable.  For  a  reader  or  listener  to  understand 
and  accept  other  decisions,  however,  detailed  knowledge  of  FORCEM  is 
required.  This  is  a  consequence  of  the  fact  that  the  need  for  and  format 
of,  C^  decisions  is  driven  by  the  structure  of  FORCEM;  i.e.,  C^  must  be 
tied  to  (and  integrate)  the  representations  of  the  other  functional  areas. 

Of  the  decisions  in  Table  1-1,  all  but  the  first  are  readily  understood, 
while  that  one  falls  into  the  category  of  not  readily  understood  without 
detailed  knowledge  of  FORCEM. 
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b.  For  each  decision,  what  are  the  critical  data;  i.e.,  what  are  the 
pertinent  data  items  from  the  perception  data  base? 

Given  only  the  variables  from  the  perception  data  base  that  are  used  in  the 
current  rules,  the  subjects  indicate  that  those  variables  are  essential  to 
the  decisions.  However,  the  subjects  suggest  several  variables  for  use  as 
decision  criteria  that  are  not  currently  in  the  FORCEM  perception  data 
base;  these  variables  are  shown  in  Figure  1-1. 


c  Rate  of  loss  for  friendly  forces 

•  Rate  of  loss  for  enemy  forces 

•  Time  in  sustained  combat  for  friendly  forces 

•  Time  in  sustained  combat  for  enemy  forces 

•  Geographical  momentum 

•  Projected  rate  of  movement 

•  Number  of  divisions  that  can  be  placed  in  area 

•  Status  of  artillery  support 

•  Status  of  CAS 


•  Control  of  air 


•  Enemy  posture 


Figure  1-1.  Additional  Perception  Data  Base  Variables 
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Also,  for  certain  decisions,  the  subjects  suggest  the  use  of  existing  per¬ 
ception  data  base  variables  as  decision  criteria  over  and  above  the  vari¬ 
ables  currently  used.  Figure  1-2  displays  these  suggestions,  with  the 
format  of  decision  followed  by  the  existing  perception  data  base  variables 
to  be  added  as  decision  criteria. 


•  Assignment  of  new  field  artillery  battalion 

••  Posture  of  potential  receiving  corps 
••  Status  of  divisional  field  artillery 

•  Designation  of  posture  of  online  corps 
••  Terrain 

••  Status  of  associated  corps  support  complex 
••  Information  on  neighboring  online  corps 

•  Priority  to  corps  (or  division)  for  CAS 

••  Posture  of  corps  (or  division) 

••  Adequacy  of  recent  CAS  support 

•  Priority  to  corps  (or  division)  for  CAS 

••  Posture  of  corps  (or  division) 

••  Current  CSS  status  of  associated  corps  support 
complex  (or  of  division  and  associated  division 
support  complex) 


Figure  1-2.  Expanded  Criteria  for  Decisions 


c.  Are  the  decision  rules  embedded  in  FORCEM  appropriate?  If  not,  how 
should  they  be  expanded  or  modified? 

For  decisions  1,  2,  and  3,  the  results  of  the  experiments  do  not  match  the 
rules  currently  in  FORCEM.  The  decisions  generated  by  the  experimental 
data  differ  clearly  from  those  generated  by  the  current  rules.  This  indi¬ 
cates  that  the  rules  could  be  replaced  with  table  lookup  procedures  based 
on  the  experimental  data  in  order  to  obtain  "better"  decisions.  However, 
the  limited  experience  of  the  subjects  in  decisionmaking  at  the  echelons 
considered  in  the  experiments,  and  the  lack  of  knowledge  of  the  subjects 
about  FORCEM  itself,  argue  for  great  caution  in  accepting  the  experimental 
data  as  gospel  and  applying  such  data  in  FORCEM.  In  summary,  the  experi¬ 
ments  for  decisions  1,  2,  and  3  do  not  validate  the  rules  currently  in 
FORCEM;  but  the  experiments  do  not  invalidate  the  rules  either. 


For  decisions  4  through  3,  the  decisions  in  FORCEM  are  already  made  using 
table  lookup  procedures.  The  data  from  the  experiments  can  be  used  in  pre 
paring  inputs  for  the  tables. 
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1-10.  SUMMARY  OF  KEY  FINDINGS  AND  RECOffiENDATIONS.  Major  findings  are 
documented  in  paragraph  1-9  above.  The  following  are  additional  findings 
and  recommendations: 

a.  Findings.  The  techniques  applied  in  this  study--off 1 ine  experiments 
with  human  subjects  acting  as  decisionmakers,  followed  by  statistical 
analysi s--are  useful  for  developing  decision  rules  initially  or  revising 
existing  rules. 

b.  Recommendations 

(1)  For  testing  purposes,  table  lookup  procedures  should  be  installed 
in  FORCEM  for  decisions  1,  2,  and  3.  Then  testing  should  be  conducted  to 
assess  the  reasonableness  of  the  outcomes  of  the  decisions  when  the  data 
from  this  study  are  used. 

(2)  The  primary  focus  of  this  study — decision  rules  in  FORCEM--and 
the  approach  taken  in  considering  the  rules— offl ine  experiments  based  on 
the  decisions—yield  little  information  regarding  the  use  of  FORGE. 

Furthermore,  due  to  the  schedule  for  development  of  FORGE,  and  the 
constraint  on  time  for  this  study,  no  further  consideration  is  given  to 
FORGE.  Nevertheless,  the  following  limited  suggestion  about  FORGE  can  be 
made:  the  techniques  for  gathering  data  for  this  study  can  be  adapted  to 
yield  methods  for  recording  FORGE  gamers'  decision  processes.  After  the 
gamers  have  completed  a  cycle  of  decisionmaking  and  the  simulation  is 
reactivated,  the  gamers  can  be  queried  to  ascertain  the  reasons  for  their 
decisions  and  the  relative  importance  of  the  reasons. 

(3)  Whether  and  how  to  use  FORGE  to  validate  and  enhance  the  decision 
rules  in  FORCEM  should  be  topics  for  future  studies. 


CAA-SR-86-5 


CHAPTER  2 

TECHNICAL  APPROACH 


2-1.  OVERVIEW.  The  primary  approach  is  to  develop  and  apply  statistical 
experiments  for  major  FORCEM  decisions.  The  design  and  conduct  of  the  exper 
ments  are  discussed  briefly  in  paragraph  2-2  and  in  greater  detail  in 
Chapters  4  through  6.  Prior  to  the  conduct  of  the  full  set  of  experiments, 
several  pilot  experiments  are  conducted  to  determine  the  feasibility  of  the 
experimental  approach.  Material  on  these  pilot  experiments  is  contained  in 
paragraph  2-3  and  in  Chapter  3.  In  order  to  solicit  subjects'  insights  on 
topics  other  than  simply  how  the  decisions  should  be  made,  questionnaires 
are  administered  at  the  completion  of  experiment  sessions  (see  paragraph 
2-4).  The  Red  perspective  is  addressed  to  a  limited  extent  through  discus¬ 
sions  with  Soviet  experts  (see  paragraph  2-5). 

2-2.  EXPERIMENTS 

a.  Eight  FORCEM  C?  decis  ions  are  selected  for  experimentation  (see 
Table  1-1).  The  decisions  are  selected  because  they  are  important  decisions 
in  FORCEM,  because  they  are  simple  decisions  (as  opposed  to  complex  construe 
tions  combining  several  other  decisions),  and  because  they  are  amenable  to 
the  experimental  technique.  For  each  decision,  an  experiment  is  designed 
wherein  the  perception  data  base  variables  (used  in  the  rules  currently  in 
FORCEM)  are  controlled  and  varied.  For  each  case  (with  a  value  assigned  to 
each  perception  data  base  variable),  the  subject  is  asked  what  the  decision 
should  be.  Each  experiment  (one  decision,  a  number  of  cases)  is  adminis¬ 
tered  to  a  group  of  subjects  from  the  US  Army  War  College.  In  order  to 
provide  the  subjects  with  background  information  on  FORCEM  C^  and  on  the 
significance  of  the  decision  under  consideration,  an  information  paper  is 
prepared  for  each  experiment  and  distributed  prior  to  the  conduct  of  the 
experiment  (see  Appendix  C). 

b.  For  each  experiment,  mean  values  (across  subjects)  are  computed. 

Then  analysis  of  variance  is  applied  to  the  results  to  determine  what  vari¬ 
ables  are  significant,  i.e.,  essential  to  making  the  decision.  Then  regres¬ 
sion  analysis  is  applied  to  obtain  an  equation  for  predicting  the  proper 
value  of  the  decision  based  on  the  values  of  the  significant  variables. 

Then  comparisons  are  made  among  the  decisions  made  in  accordance  with  the 
mean  values,  the  prediction  equation,  and  the  rules  currently  in  FORCEM. 
Results  and  recommendations  that  follow  from  these  analyses  are  given  in 
Chapter  7. 

2-3.  PILOT  EXPERIMENTS.  To  determine  the  feasibility  of  the  experimental 
technique  described  in  paragraph  2-2  above,  three  pilot  experiments  are 
conducted  at  the  US  Army  Concepts  Analysis  Agency  (CAA)  prior  to  the  admin¬ 
istration  of  the  full  set  of  experiments  to  subjects  outside  CAA.  Two  of 
the  three  experiments  are  successful,  and  are  therefore  included  as  experi¬ 
ments  in  the  study  itself.  The  third  is  not  successful,  and  is  therefore 
dropped  from  further  consideration.  Based  on  the  success  of  the  two 
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experiments,  a  "go-ahead"  is  given  to  proceed  to  a  full  set  of  experiments 
for  administration  to  subjects  outside  CAA.  For  further  details  on  the 
pilot  experiments,  see  Chapter  3. 

2-4.  QUESTIONNAIRES.  The  experiments  and  subsequent  statistical  analysis 
address  the  issues  of  whether  the  variables  from  the  perception  data  base 
that  are  currently  used  in  the  rules  in  FORCEM  are  "significant"  (i.e., 
relevant  to  the  decisions),  and  how  they  should  be  used  in  the  decisions. 

Not  addressed  is  the  issue  of  whether  other  information  should  be  considered 
in  making  the  decisions.  To  solicit  this  type  of  information,  a  question¬ 
naire  is  prepared  by  the  US  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences  (ARI)  for  completion  by  subjects  after  the  experiments.  A 
copy  of  the  questionnaire  is  contained  in  Appendix  D.  The  written  responses 
of  subjects  are  compiled  in  Appendix  E.  A  summary  by  ARI  of  quantitative 
responses  to  the  questionnaire  is  given  in  Appendix  F.  Useful  information 
gleaned  from  the  questionnaire  is  of  two  kinds:  additional  information 
that  should  be  available  for  use  in  decisionmaking  that  is  not  currently 
available  (i.e.,  candidate  data  for  incorporation  into  the  perception  data 
base),  and  additional  data  that  should  be  used  in  making  specific  decisions 
(i.e.,  existing  perception  data  base  variables  that  should  be  used  in  the 
rules  in  FORCEM  to  augment  the  variables  already  used).  Further  information 
on  these  two  types  of  data  can  be  found  in  Chapter  7  and  Appendices  K  and 
L. 


2-5.  DISCUSSIONS.  To  ascertain  the  extent  to  which  FORCEM  decisions  and 
the  current  decision  rules  reflect  Soviet  thinking,  discussions  are  held 
with  experts  in  Soviet  doctrine  and  tactics.  The  resulting  observations 
and  suggestions  are  incorporated  into  Appendix  J. 
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CHAPTER  3 
PILOT  EXPERIMENTS 


3-1.  INTRODUCTION 

a.  Prior  to  embarking  on  a  large  data  collection  effort,  three  pilot 
experiments  are  conducted  at  CAA  to  determine  the  feasibility  of  the  experi¬ 
mental  technique.  The  decisions  on  which  the  pilot  experiments  are  based 
are:  assignment  of  a  new  corps  (Table  1-1,  decision  1),  designation  of 
posture  of  online  corps  (Table  1-1,  decision  4),  and  designation  of  corps 
type  of  operation  (not  shown  in  Table  1-1).  The  experiments  for  decisions 

1  and  4  are  successful.  The  experiment  for  the  decision  on  corps  type  of 
operation  shows  that  the  information  about  the  meaning  and  use  of  this  model 
variable  that  can  be  provided  to  the  subjects  is  insufficient  to  permit 
them  to  discriminate  among  the  (eight)  values  of  the  variable  and  thereby 
to  select  the  value  sensibly.  Consequently,  the  decision  on  corps  type  of 
operation  is  excluded  from  consideration  for  experimentation  in  the  study. 

b.  The  results  obtained  for  decisions  1  and  4  are  sufficiently  encourag¬ 
ing  to  warrant  proceeding  to  a  full  set  of  experiments  for  administration 

to  subjects  outside  CAA. 

c.  For  illustrative  purposes,  this  chapter  describes  the  pilot  test  for 
decision  1.  This  test  involves  designing  the  experiment,  conducting  the 
experiment,  performing  statistical  analysis  to  develop  a  prediction 
equation,  comparing  the  predicted  values  with  the  mean  values  of  the  experi¬ 
mental  data  and  with  the  results  of  the  rules  currently  in  FORCEM,  and  test¬ 
ing  the  prediction  equation  in  FORCEM  itself. 

3-2.  DESIGN.  As  currently  coded  in  FORCEM,  the  decision  on  assignment  of 
a  new  corps  involves  placing  it  in  reserve  status  behind  an  online  corps 
(for  possible  later  commitment  to  assist  that  online  corps  or  one  of  its 
neighboring  online  corps),  and  is  accomplished  by  ranking  the  potential 
receiving  online  corps  according  to  need  and  then  selecting  the  one  with 
greatest  need.  This  experiment  addresses  the  process  of  determining  the 
rank  (i.e.,  need)  of  a  potential  receiving  online  corps.  The  rules  used  in 
determining  the  rank  of  a  potential  receiving  online  corps  utilize  five 
perception  data  variables,  combined  for  this  experiment  into  the  four  factors 
A,  B,  C,  and  D  shown  below%  Explanations  of  the  perception  data  base  vari¬ 
ables  are  given  in  the  first  information  paper  in  Appendix  C. 

A:  Whether  given  online  corps  already  has  a  reserve  corps  behind  it. 

8:  Engagement  status  of  given  online  corps. 

C:  Friendly-to-enemy  force  ratio  faced  by  given  online  corps. 
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0:  Combination  of  -- 

•  Location  of  objective  of  online  corps  relative  to  location  of 
corps  (objective  is  "forward,"  "reached,"  or  "to  rear"  of  corps; 
i.e.,  corps  is  to  move  forward,  hold,  or  move  to  rear). 

•  Posture  of  given  online  corps  (attack,  defend,  delay,  withdraw). 

Of  the  combinations  of  location  and  posture  for  factor  D,  only  the  six  shown 
in  Table  3-1  are  possible. 


Table  3-1.  Possible  Location/Posture  Combinations 


Objective 

location 


Rear 

Reached 

Forward 


Withdraw 


Delay 


Posture 


Defend 


Attack 


The  levels  considered  for  the  four  factors  A,  B,  C,  and  D  are  shown  in 
Table  3-2.  Each  of  the  factors  is  crossed  with  each  of  the  other  factors. 
Consequently,  the  basic  experiment  has  a  2x2x2x6  factorial  design  with  48 
cells. 


Table  3-2.  Levels  of  Decision  Factors 


Factor 


Levels 


No  res 


Not  eng 


Rear/ 

Withdraw 


Has  res 


Engaged 


Reached/ 

Delay 


Reached/'  Forward/  Forward/  Forward/ 

Defend  Delay  Defend  Attack 
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Administering  the  experiment  involves  asking  a  subject  to  specify  a  "criti¬ 
cality  index"  (from  0  to  100)  for  a  particular  combination  of  factors. 

This  criticality  index  indicates  the  need  of  the  potential  receiving  online 
corps.  A  sample  question  is  shown  in  Appendix  G,  Figure  G-l.  In  order  to 
assess  the  variability  of  subject,  the  variable  T,  Subject,  is  also  treated 
as  a  factor.  This  gives  the  four  "fixed"  factors  A,  3,  C,  and  D,  and  the 
one  "random"  factor  T.  Five  of  the  48  cells  are  replicated  to  provide  an 
estimate  of  residual  variability. 

3-3.  CONDUCT  OF  EXPERIMENT.  Nine  field  grade  officers  on  duty  at  CAA  are 
selected  as  subjects.  Each  subject  is  asked  the  full  set  of  53  questions 
(48  cells  plus  5  replicates).  A  sample  question  is  shown  in  Appendix  G, 
Figure  G-l. 

3-4.  STATISTICAL  ANALYSIS 

a.  First  of  all,  the  data  are  averaged  over  all  subjects  to  obtain  mean 
values  for  the  48  cells.  The  resulting  cell  means  are  shown  in  Appendix  G, 
Table  G-l.  The  marginal  means  are  shown  in  Appendix  G,  Table  G-2.  An  exam¬ 
ination  of  Table  G-2  indicates  that  the  larges1-,  effect  of  the  three  two- 
level  factors  is  C  (force  ratio). 

b.  The  next  step  is  analysis  of  variance  (ANOVA). 

yj_  =  'm'-  +  A  +  B  +  C  +  D  +  T 

+  AB  +  AC  +  • • •  +  OT  +  • • •  +  ABCDT 
+  Residual 

where  y3  represents  criticality  index,  m'  is  an  unknown  constant;  A,  3,  C, 

0,  and  T  are  as  defined  above.  The  ANOVA  table  is  given  in  Appendix  G, 

Table  G-3.  Main  effects  and  interaction  effects  that  are  sianificant  at 
the  0.05  and  0.01  levels  of  significance  are  identified.  Even  though  many 
of  the  subject  interactions  are  significant,  tests  of  the  fixed  factors' 
effects  are  sufficiently  powerful  to  detect  significant  main  effects  and 
interaction  effects.  All  four  main  effects  A,  B,  C,  and  D  are  statisti¬ 
cally  significant,  as  are  two  interaction  effects  AC  and  CO.  This  yields 

(yi)ijkm  =  'v'  +  Aj  +  Bj  +  C|<  +  Dm  A^C^  +  3- 


The  ANOVA  model  is 

(3-1) 


as  a  candidate  model  for  a  prediction  equation.  Regression  analyses  w’t 
dummy  variables  is  used  to  develop  the  following  prediction  equation: 

yi  =  34.3  -  ( 19.6)  (A)  +(6.9)  (B)  -  (20.11(C)  -  O.bVOi' 

+  (3.9) (D2)  +  (13.2) (D3)  +  (48.4' (04) 

+  (9-9)  (D5)  +  (7.8)  (A)  (C )  +  (3.91(00!' 

-  (2.6)  (C)  (03)  -  { 37.6)  (C)  (04 )  -  (3.2VC)'V 
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where  A  =  1  if  given  online  corps  already  has  a  corps  in  reserve  behind  it 

=  0  if  given  online  corps  has  0  corps  in  reserve 

3  =  1  if  given  online  corps  is  engaged 

=  0  if  given  online  corps  is  not  engaged 

C  =  1  if  force  ratio  is  3:1 

=  0  if  force  ratio  is  1:3 

D]_  =  1  if  location/posture  is  rear/withdraw 
=  0  otherwise 

02  =  1  if  posture  is  delay 
=  0  otherwise 

D3  =  1  if  posture  is  defend 
=  0  otherwise 

□4  =  1  if  posture  is  attack 
=  0  otherwise 

D5  =  1  if  location  is  forward 
=  0  otherwise 

c.  The  factor  D  is  treated  using  the  five  variables  Di  through  O5,  rat¬ 
her  than  through  a  family  of  variables  that  reference  the  levels  for  D  shown 
in  Table  3-1,  in  order  to  allow  segregation  of  the  contributions  of  location 
and  posture. 

d.  Equation  (3-3)  is  used  to  compute  predicted  "criticality  values"  for 
each  of  the  43  cells.  Table  G-4  shows  the  predicted  criticality  values  and 
associated  ranking  by  need,  cell  means  and  associated  ranking  by  need,  and 
ranking  by  need  per  the  rules  currently  in  FORCEM.  Note  that  the  ranking 
generated  by  equation  (3-3)  agrees  well  with  the  ranking  from  the  cell  means, 
but  does  not  match  the  ranking  specified  by  the  rules  currently  in.  FORCEM. 

One  explanation  for  the  latter  discrepancy  can  be  seen  by  inspection  of 
Table  G-4.  The  driving  factor  in  equation  (3-3)  is  D4  (whether  or  not  the 
online  corps  has  a  posture  of  attack);  on  the  other  hand,  the  driving  factor 
for  the  rules  currently  in  FORCEM  is  A  (whether  or  not  the  online  corps 
already  has  a  reserve  corps  behind  it). 

3-5.  PROTOTYPE  IMPLEMENTATION 

a.  As  noted  above,  the  ranking  generated  by  the  prediction  equation 
‘,3-3)  (equivalently,  by  the  cell  means),  does  not  match  the  ranking  from 
toe  roles  currently  in  FORCEM.  The  next  question  is  whether,  in  the  situa¬ 
tions  that  occur  in  actual  execution  of  FORCEM,  the  differences  in  ranking 
yieli  diff:rent  assignments  af  new  corps.  That  is--"So  What!" 
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b.  As  a  test,  code  is  installed  in  FORCEM  to  permit  comparison  of  the 
two  methodologies  for  assigning  a  new  corps  to  reserve  status  behind  a 
selected  online  corps  based  on  the  ranking  (by  need)  of  the  potential  receiv 
ing  online  corps-- 

(1)  According  to  the  rules  currently  in  FORCEM. 

(2)  According  to  equation  (3-3). 

c.  Rather  than  simply  comparing  the  final  selection  of  the  online  corps 
to  receive  the  new  corps,  the  approach  taken  here  is  to  compare  the  complete 
ranking  of  all  potential  receiving  online  corps. 

d.  A  sample  situation  is  shown  in  Appendix  G,  Table  G-5.  There  are  15 
potential  receiving  online  corps.  The  ranking  values  for  both  approaches 
are  taken  from  Tabic  G-4.  In  the  displayed  situation,  and  in  the  other 
situations  where  this  decision  is  examined  in  this  prototype  implementation, 
the  rankings  generated  by  the  two  methodologies  match,  in  the  sense  that 
their  orderings  are  the  same.  This  would  not  be  the  case,  however,  were 
some  of  the  potential  receiving  online  corps  to  have  postures  of  defend  or 
have  unfavorable  force  ratios. 

e.  Thus  the  results  of  this  prototype  test  are  inconclusive. 

3-6.  CONCLUSION.  For  decision  1,  the  14-term  prediction  equation  (3-3) 
resulting  from  the  ANOVA  and  regression  analysis  provides  an  adequate  fit 
to  the  cell  means  data.  A  similar  conclusion  can  be  drawn  about  decision 
4,  considered  in  the  second  pilot  experiment.  These  pilot  experiments  are 
considered  successful.  A  "go-ahead"  is  given  to  proceed  to  a  full  set  of 
experiments  for  administration  to  subjects  outside  CAA.  Decisions  1  and  4 
are  included  in  that  set  of  experiments. 


CAA-SR-36-5 


CHAPTER  4 

EXPERIMENTAL  DESIGN 


4-1.  INTRODUCTION.  This  chapter  describes  the  design  for  the  experiments 
for  the  FORCEM  decisions  considered  for  the  study.  These  decisions  are 
shown  in  Table  4-1,  repeated  here  from  Table  1-1  for  the  convenience  of  the 
reader. 


The  factors  used  in  the  experiments  are  shown  in  Table  4-2.  Interpretations 
of  these  factors  are  provided  in  the  information  papers  in  Appendix  C. 


Table  4-2.  Decision  Factors 


Symbol 

Interpretation 

A 

Has  reserve  corps 

B 

Corps  engagement  status 

C 

Corps  force  ratio 

D 

Location  of  objective  of  corps/posture  of  corps 

E 

Echelon  to  which  corps  assigned/has  reserve  corps 

F 

Echelon  to  which  corps  assigned 

G 

Ratio  of  corps  artillery  battalions  to  divisions 

M 

Location  of  objective  of  corps 

N 

Posture  of  parent  army 

P 

Division  engagement  status 

R 

Division  force  ratio 

S 

Echelon  to  which  division  assigned 
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The  levels  for  each  factor  are  selected  in  order  to  provide  a  realistic 
range  while  keeping  the  total  number  of  cells  for  a  given  experiment  manage¬ 
able.  The  levels  are  displayed  in  Table  4-3.  For  any  factor  appearing  in 
several  experiments,  the  levels  used  are  the  same.  Note  that  three  levels 
are  chosen  for  factor  C,  rather  than  the  two  levels  used  in  the  pilot  experi¬ 
ment  described  in  Chapter  3. 


Table  4-3.  Levels  of  Decision  Factors 


Level 


No  res 

Has  res 

No  res 

Engaged 

1:3 

1:1 

3:1 

Rear/ 

Withdr 

Reached/ 

Delay 

Reached/ 

Defend 

Reserv 

Onln/Yes 

Onln/No 

Reserv 

Onl ine 

1.00 

0.25 

Rear 

Reached 

Forward 

Del  ay 

Defend 

Attack 

No 

1:3 

First 

Yes 

1:1 

Second 

3:1 

Third 

Fwd/ 

Delay 


Fwd/ 

Defend 


Fwd/ 

Attack 
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All  the  factors  within  each  experiment  are  completely  crossed  with  all  other 
factors  of  the  experiment.  Consnuently,  all  designs  are  factorial  designs. 
The  factors  and  numbers  of  cells  are  shown  in  Table  4-4.  In  order  to  esti¬ 
mate  the  residual  (i.e.,  error  variance),  several  cells  are  replicated  for 
each  experiment;  e.g.,  for  decision  1,  there  are  72  cells  in  the  basic 
design  plus  4  replicates.  The  replication  of  cells  permits  the  estimation 
of  residual,  albeit  a  less  reliable  estimate  than  that  afforded  by  replica¬ 
tion  of  all  cells. 


Table  4-4.  Factors  in  Experiments 


Decision 

number 

Factors 

Number  of 
levels 

Number  of 
cells 

i 

AxBxCxD 

2x2x3x6 

72 

2 

BxCxDxE 

2x3x6x3 

108 

3 

BxDxFxG 

2x6x2x2 

48 

4 

CxMxN 

3x3x3 

27 

5 

BxCxF 

2x3x2 

12 

6 

BxCxF 

2x3x2 

12 

7 

PxRxS 

2x3x3 

18 

8 


PxRxS 


2x3x3 


13 
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CHAPTER  5 
DATA  COLLECTION 


5-1.  INTRODUCTION 

a.  Each  experiment  shown  in  Table  4-1  is  administered  to  a  group  of 
subjects  from  the  US  Army  War  College.  The  experiments  were  administered 
on  four  afternoons  of  December  2  and  5,  1985  and  January  8  and  10,  1986. 

Each  afternoon  consists  of  two  sessions,  two  hours  each,  at  which  approx¬ 
imately  10  subjects  are  administered  several  of  the  eight  decisions  in  suc¬ 
cession,  and  then  the  questionnaire  (Appendix  D)  prepared  by  US  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences  (ARI).  The  various  cases 
of  a  particular  experiment  are  presented  to  a  subject  on  a  VAX  11/780  term¬ 
inal.  Each  case  so  presented  consists  of  a  unique  set  of  levels  of  each 
factor  involved  in  the  experiment.  For  instance,  in  experiment  1  (Assign¬ 
ment  of  New  Corps),  the  subject  is  presented  with  a  unique  case  involving 
an  online  corps.  The  subject  is  told  that  the  online  corps:  (1)  has  no 
corps  in  reserve  behind  it  (level  1  of  factor  A;  see  Tables  4-2  and  4-3); 

(2)  is  engaged  (level  2  of  factor  B);  (3)  has  a  friendly-to-enemy  force 
ratio  of  1:1  (level  2  of  factor  C);  and  (4)  is  defending  and  has  reached 
the  location  of  the  parent  army's  objective  (level  3  of  factor  D).  .This 
unique  case  is  denoted  as  the  four-tuple  (1,  2,  2,  3),  or  1223  for  short. 

For  experiment  1,  there  are  72  cases  formed  by  selecting  one  level  of  each 
of  the  four  factors.  All  72  cases  are  presented  to  each  subject.  Each 
such  case  is  called  a  cell  in  statistical  terminology.  Each  experiment  is 
replicated  by  administering  it  to  a  number  of  different  subjects.  The  avail¬ 
able  subjects  are  divided  into  eight  groups.  Table  5-1  shows  the  allocation 
of  experiments  (decisions  1  through  8)  to  subject  groups  (a  through  h). 

The  subjects  are  assumed  to  be  a  random  sample  from  a  population  well  versed 
in  making  combat  decisions  of  this  kind. 


Table  5-1.  Allocation  of  Subjects  to  Experiments 


Group 


Decision 
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Each  of  experiments  1,  2,  3,  7,  and  8  is  administered  to  20  subjects.  Each 
of  experiments  5  and  6  is  administered  to  21  subjects.  Experiment  4  is 
administered  to  all  31  subjects.  Since  these  experiments  involve  repeti¬ 
tious  operations,  the  order  of  cell  presentation  may  be  important,  either 
because  a  learning  process  is  involved  which  tends  to  make  later  responses 
better  than  earlier  ones,  or  because  fatigue  tends  in  the  opposite  direction. 
Randomization  is  a  statistical  technique  which  is  applied  to  the  order  of 
presentation  of  the  cells  in  order  to  avoid  possible  biases  that  might  favor 
or  handicap  a  particular  cell  affected  by  some  extraneous  source  of  varia¬ 
tion  correlated  with  the  fixed  order  of  presentation.  Each  subject  is  pre¬ 
sented  with  a  different  random  ordering  of  the  presentation  of  cells.  In 
order  to  give  the  subject  experience  prior  to  the  actual  conduct  of  an  experi 
ment,  the  subject  is  presented  with  3  to  5  sample  cells  which  do  not  count. 
Also  for  each  of  experiments  1,  2,  3,  5,  6,  7,  and  8,  four  of  the  cells  are 
picked  at  random  in  the  preparation  stage  of  the  experiment,  and  are  given 
twice  during  the  experiment  for  a  measure  of  wi thin-subject  variation.  These 
replications  are  used  in  subsequent  analysis  to  measure  random  error.  The 
four  replicated  cells  for  each  experiment  are  incorporated  into  the  order 
randomization  scheme  for  the  nonrepl icated  cells  as  described  abo.ve. 

b.  Lastly,  Table  5-2  summarizes  the  background  of  the  subjects  by  rank 
and  branch  affiliation. 


Table  5-2.  Subject  Background 


Branch 

Rank 

Other 

Total 

or 

service 

COL 

LTC 

AD 

2 

3 

5 

AG 

0 

1 

1 

AR 

1 

13 

14 

AV 

0 

3 

3 

CE 

1 

0 

1 

CM 

0 

1 

1 

DC 

I 

0 

1 

EN 

1 

5 

6 

FA 

3 

9 

12 

FI 

0 

1 

1 

IN 

2 

12 

14 

MI 

1 

3 

4 

MP 

1 

1 

2 

MS 

1 

0 

1 

OD 

0 

3 

3 

QM 

0 

1 

1 

SC 

0 

3 

3 

TC 

1 

0 

1 

USAF 

Civilian  &  other 

1 

1 

5 

2 

5 

Total 

16 

60 

5 

31 

CAA-SR-86-5 


5-2.  DATA 

a.  The  raw  data  for  experiments  1,  2,  3,  5,  6,  7,  and  3  are  tabulated 
in  Appendix  H,  Tables  H-l  through  H-7.  The  first  column  of  each  of  these 
tables  is  an  n-tuple  that  identifies  the  cell  by  indicating  the  level  of 
each  of  the  factors  that  make  up  the  cell.  For  example,  in  Table  H-l,  the 
four-tuple  1223  (the  27th  entry  from  the  top  in  the  first  column)  indicates 
the  cell:  (1)  no  corps  in  reserve  (level  1  of  factor  A;  see  Table  4-2  and 
Table  4-3);  (2)  is  engaged  (level  2  of  factor  8);  (3)  has  a  friendly-to- 
enemy  force  ratio  of  1:1  (level  2  of  factor  C);  and  (4)  is  defending  with 
the  objective  location  as  reached  (level  3  of  factor  0).  Each  entry  in  a 
row  from  the  second  column  to  the  twenty-first  (experiments  1,  2,  3,  7,  and 
8)  or  the  twenty-second  (experiments  5  and  6)  is  the  criticality  response 
given  by  an  individual  subject  to  the  cell  labeled  in  column  one.  The  next 
to  last  column  of  each  row  is  the  mean  of  the  row,  and  the  last  column  is 
the  standard  deviation  of  the  row.  Following  the  main  body  of  the  table 
are  two  spaced  rows  with  no  n-tuple.  The  first  row  is  the  mean  response 

for  each  subject.  The  second  row  is  the  standard  deviation  for  each  subject. 
Following  these  two  summary  rows  are  the  replication  data  in  the  same  format 
as  the  main  body  of  the  table. 

b.  The  raw  data  for  experiment  4  are  tabulated  in  Appendix  H,  Table 
H-8.  In  experiment  4,  the  subject  is  asked  to  respond  to  a  particular  cell 
description  of  the  experiment  by  designating  one  of  the  four  postures  attack, 
defend,  delay,  or  withdraw.  All  81  subjects  are  given  experiment  4.  The 
three-tuple  identifies  the  levels  of  factors  C,  M,  and  N  (see  Table  4-1  and 
Table  4-2)  for  the  row.  The  second  through  fifth  columns  give  the  number 

of  subjects  responding  with  the  posture  indicated  by  the  label  above  the 
column.  The  three  columns  at  the  right  describe  the  cell  in  FORCEM 
terminology. 
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CHAPTER  6 

STATISTICAL  ANALYSIS 


6-1.  INTRODUCTION.  This  chapter  describes  the  statistical  analysis  per¬ 
formed  on  the  data  collected  from  the  experiments.  Two  oasic  approaches 
are  applied  to  the  decisions  listed  in  Table  4-1.  The  first  approach-- 
applied  to  decisions  1,  2,  3,  5,  6,  7,  and  8 — i s  treated  in  paragraph  6-2. 
Supporting  data  are  shown  in  Appendix  I.  The  second  approach--appl ied  to 
decision  4 - - i s  treated  in  paragraph  6-3. 

6-2.  FIRST  APPROACH.  Decisions  1,  2,  3,  5,  6,  7,  and  8  are  treated  with 
the  same  approach--ANOVA  followed  by  regression  analysis.  The  first  step 
for  each  decision  is  an  ANOVA  of  the  experiment  as  designed  per  Chapter  4. 
This  yields  an  additive  model,  referred  to  as  the  ANOVA  model.  It  allows 
the  sum  of  squares  to  be  partitioned  into  terms  representing  main  effects, 
interactions,  and  error  components.  Each  of  the  effect  mean  squares  may 
then  be  divided  by  the  error  mean  square  to  yield  a  ratio  that--under  the 
assumptions  of  the  ANOVA  model  and  the  null  hypothesis--is  distributed  as  F 
(i.e.,  Fisher  distribution)  with  appropriate  degrees  of  freedom.  The  main 
advantage  of  the  ANOVA  model  is  that  it  permits  determining  which  effects 
and  which  interactions  account  for  a  significant  amount  of  the  variation  in 
the  data.  On  the  other  hand,  the  ANOVA  model  is  usually  overparameterized 
and  hence  unwieldy  for  use  as  a  prediction  model.  Frequently,  the  informa¬ 
tion  in  the  ANOVA  model  can  be  adequately  captured,  and  more  parsimoniously 
expressed,  in  a  regression  equation.  This  is  particularly  true  when  most 
of  the  variation  is  accounted  for  in  the  main  effects  and  a  few  lower-order 
interaction  terms.  Regarding  the  decisions  considered  here,  another  advan¬ 
tage  of  a  regression  model  is  that  it  allows  naturally  continuous  variables 
(e.g.,  C  and  G  of  Table  4-2)  to  be  treated  as  continuous.  For  these  reasons, 
the  second  step  in  the  statistical  analysis  of  each  of  the  decisions  1,  2, 

3,  5,  6,  7,  and  8  is  to  develop  a  prediction  equation  using  regression 
analysis.  The  final  step  is  to  compare  the  values  given  by  the  rules  cur¬ 
rently  in  FORCEM  with  those  predicted  by  the  cell  means  and  with  those  pre¬ 
dicted  by  the  regression  equation. 

a.  To  illustrate  this  approach,  the  treatment  of  decision  1  (Assignment 
of  New  Corps)  is  now  discussed  in  detail.  For  the  other  decisions,  results 
are  shown  later  in  this  chapter,  and  details  are  provided  in  Appendix  I. 

The  ANOVA  model  for  decision  1  is 

y\  -  m"  +  A  +  B  +  C  +  D  +  T 

+  AB  +  AC  +  ...  +  DT  +  ...  +  ABCDT  (6-1) 

+  Residual 


Where  y\  represents  the  criticality  (value  between  0  and  100)  of  assigning 
the  new  corps  to  reserve  status  behind  the  given  online  corps;  il"  is  an 
unknown  constant;  A,  B,  C,  and  D  are  the  fixed  factors  described  in  Table 
4-2  with  the  levels  shown  in  Table  4-3;  and  T  is  the  random  factor  contain¬ 
ing  the  subject  effect.  First  of  all,  the  experimental  data  are  averaged 


/// 
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across  all  subjects  to  obtain  cell  means;  these  are  displayed  in  Appendix  I, 
Table  1-4.  The  marginal  means  are  shown  in  Appendix  I,  Table  1-5.  Then 
ANOVA  is  applied;  the  ANOVA  table  for  the  experimental  data  is  displayed  in 
Appendix  I,  Table  1-6.  Of  primary  interest  in  this  table  are  the  main 
effects  and  their  interactions.  However,  in  order  to  explain  the  ANOVA 
table  it  is  best  to  begin  at  the  bottom  and  move  upward.  The  component  of 
the  table  labeled  "Error"  relates  to  random  error  within  subject.  As  noted 
in  Chapter  4,  four  of  the  questions  are  replicated  for  this  experiment  in 
order  to  estimate  the  residual  (i.e.,  error  variance).  The  mean  square 
error  term  of  the  error  component  is  used  to  test  each  of  the  other  random 
effects  (i.e.,  factor  T  and  every  higher-order  interaction  term  containing 
T).  Dividing  each  such  mean  square  term  by  the  corresponding  error  mean 
square  term  yields  a  ratio  that  is  distributed  as  F  under  the  null  hypoth¬ 
esis  (e.g.,  <*t2  =  o,  <rAy2  =  0).  As  indicated  in  Table  1-6,  many  random 
components  are  significant.  Whether  this  is  due  to  an  unreliable  error 
estimate,  or  to  random  components  that  are  truly  significant,  cannot  be 
determined.  Because  the  primary  focus  here  is  the  fixed  effects,  and 
because  the  variation  in  the  random  components  does  not  overwhelm  the  varia¬ 
tion  in  the  fixed  effects,  the  significance  of  the  random  components  need 
not  be  considered  further.  Each  fixed  effect's  mean  square  error  is  tested 
against  the  variance  component's  mean  square  error;  e.g.,  A  is  tested 
against  AT;  ABCD  is  tested  against  ABCDT.  Under  the  null  hypothesis  one 
expects  no  level  effect  for  a  particular  factor  or  factor  interaction  term. 
Under  the  null  hypothesis  and  the  assumptions  of  normal,  independent  and 
identically-distributed  error,  the  ratio  of  mean  square  error  associated 
with  a  particular  factor  or  factor  interaction  to  the  mean  square  error  is 
distributed  as  F  with  m  degrees  of  freedom  associated  with  the  particular 
factor  or  factor  interaction  mean  square  and  n  degrees  of  freedom  asso¬ 
ciated  with  the  mean  square  error.  To  reject  the  null  hypothesis,  and  say 
that  there  is  at  least  one  significant  difference  due  to  the  particular 
factor  or  factor  interaction,  the  ratio  of  means  squares  (F-ratio)  must  be 
greater  than  the  value  of  the  F  distribution  with  m  and  n  degrees  of  freedom 
at  some  chosen  level  significance  a .  The  data  of  this  experiment  do  not 
adhere  strictly  to  the  assumptions,  but  the  ANOVA  model  is  somewhat  robust. 
The  main  problem  of  violation  occurs  with  distribution  of  the  responses  and 
probably  with  inequality  of  variance.  Provided  that  such  violations  can  be 
ignored,  the  primary  conclusions  to  be  drawn  are  that  only  the  main  effects 
A,  B,  C,  and  D,  and  the  two  higher-order  interactions  AC  and  CD,  are  signif¬ 
icant  at  the  alpha  =  0.01-level.  Two  other  interaction,  AB  and  ACD  are 
significant  at  the  alpha  =  0.05-level. 

b.  If  FORCEM  is  to  apply  a  table  lookup  procedure  to  make  the  decision, 
then  the  cell  means  can  be  used  directly.  If,  however,  FORCEM  is  to  employ 
an  equation  to  make  the  decision,  then  a  regression  equation  yields  a  more 
tractable  model.  Essentially,  the  regression  model  seeks  to  find  a  "sub¬ 
space"  of  the  fixed  effects  in  the  ANOVA  model  that  fits  the  cell  means 
without  appreciable  error.  The  ANOVA  table  itself  provides  insight  into 
the  feasibility  of  finding  this  subspace.  If  none  or  a  few  of  the  higher- 
order  interaction  terms  are  significant,  it  is  likely  that  a  regression 
equation  can  be  obtained  with  a  reasonable  number  of  terms  that  matches  the 
ANOVA  model  without  appreciable  error.  For  decision  1,  this  is  the  case. 

The  procedure  used  to  develop  the  model  is  known  as  stepwise  regr  ssion. 
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The  prediction  equation  yielded  by  this  approach' has  the  form 

yi  =  ^1  +  (ai.l)  (A)  +  (ait2)(8)  +  (aif3)(LC) 

+  (ai,4)(W)  +  (ai>5)(FWD)  +  (ai,6)(ATT)  (6-2) 

+  (ai>7) (DEL) (RCH)  +  (ail8) (A) (LC)  +  (ai,9)(FWD)(LC2) 

This  equation  is  repeated  in  the  summary  Figure  6-1.  The  variables  y\.  A, 
ATT,  B,  DEL,  FWD,  LC,  RCH,  and  W  are  defined  in  Figure  6-2;  and  the  coef¬ 
ficients'll  >  ai  i,  etc,  are  given  in  Table  6-1.  Note  that  the  factor  D  is 
treated  using  tfie  five  variables  ATT,  DEL,  FWD,  RCH,  and  W,  rather  than 
through  a  family  of  functions  that  vary  with  the  six  levels  shown  in  Table 
4-3,  in  order  to  allow  segregation  of  the  contributions  of  location  and 
posture. 

c.  R2,  the  "coefficient  of  multiple  determination,"  is  a  measure  of  the 
variability  accounted  for  by  the  model,  and  has  a  value  between  0  and  1. 

For  the  ANOVA  model  of  decision  1,  the  value  is  0.452.  For  the  regression 
model  of  equation  6-2,  R2  is  0.436.  The  ratio  of  these  two  values  is  0.96 
out  of  a  possible  1.00,  indicating  that  the  regression  model  matches  the 
ANOVA  model  well.  Another  measure  of  the  adequacy  of  the  regression  model 
is  Mallows  Cp.  For  equation  (6-2),  p  (the  number  of  terms)  is  10,  and  Cp 
is  -12.  Since  a  value  of  Cn  less  than  p  indicates  an  adequate  model,  equa¬ 
tion  (6-2)  suffices.  Note  that  this  equation  requires  only  10  terms  to 
express  the  72  degrees  of  freedom  of  the  ANOVA  model.  Regarding  factor  C 
and  the  variable  LC,  caution  is  in  order  for  extrapolation  beyond  the  limits 
of  the  design;  i.e.,  force  ratio  between  1:3  and  3:1.  Nevertheless,  extra¬ 
polation  of  C  to  the  range  1:6  to  6:1  seems  to  be  within  reason  and  should 
not  adversely  affect  the  performance  of  the  model. 

d.  Appendix  I,  Table  1-7  displays  comparisons  of  the  criticality  index 
and  associated  ranking  by  need--for  the  regression  equation,  the  cell  means, 
and  current  F0RCEM  rules.  To  the  far  right,  the  factor  levels  are  pre¬ 
sented  in  F0RCEM  terminology.  The  ranking  by  need  generated  by  the  cell 
means  matches  with  that  generated  by  the  regression  equation.  Not  so  for 
the  ranking  generated  by  the  current  rules  when  compared  with  that  gener¬ 
ated  by  the  cell  means.  Figure  1-1  is  a  scatter  plot  comparing  these  two 
approaches.  The  diagonal  line  represents  perfect  agreement.  The  two 
approaches  are  clearly  different;  hence  the  experiment  does  not  validate 
the  current  rules. 

e.  From  equation  (6-2)  and  Table  6-1,  it  can  be  concluded  that  the  terms 
in  equation  (6-2)  involving  LC  (hence,  force  ratio)  appear  with  signs  indi¬ 
cating  the  subjects  favor  reinforcing  an  online  corps  with  a  poor  force 
ratio  over  one  with  a  good  force  ratio.  This  may  be  due  to  the  fact  that 
the  subjects  have  the  Blue  perspective;  i.e.,  "reinforce  weakness." 

f.  Decisions  2,  3,  5,  6,  7,  and  3  are  analyzed  in  the  same  manner  as 
described  for  decision  1  above.  The  forms  of  the  prediction  equations 
resulting  from  the  ANOVA  and  regression  analysis  are  shown  in  Figure  6-1. 

The  associated  variables  are  described  in  Figure  6-2;  and  the  associated 
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coefficients  are  given  in  Table  6-1.  The  information  for  decision  1  is 
repeated  in  Figure  6-1  for  completeness.  Explanations  of  the  decisions 
made  and  the  decision  criteria  used  are  given  in  Appendix  C.  Supporting 
data--cell  means,  marginal  means,  ANOVA  tables,  and  comparisons  of 
models— are  contained  in  Appendix  I.  Also  in  Appendix  I  (Table  1-3),  meas¬ 
ures  are  given  of  the  parsimony  of  the  regression  model,  adequacy  of  the 
regression  model,  percentage  variation  explained  by  the  regression  model, 
percentage  variation  explained  by  the  fixed  effects,  and  the  ratio  of  those 
two  percentages.  Specialized  comments  are  now  given  for  certain  of  the 
decisions. 

Decision  1  —  Assignment  of  New  Corps 

yi=  1  +  Ul,l)(A)  +  (ai#2)(B)  +  (ai,3)(LC) 

-  (ai>4)(W)  +  (aif5)(FWD)  +(ai>6)(ATT) 

-  (ai>7)(DEL)(RCH)  +  (aij8) (A) (LC)  +  (ai>9) (FWD) (LC2) 

Decision  2  —  Assignment  of  New  Division 

y2  =  2  +  (a2,l) (8)  +  (a2,2)(LC)  +  (a2,3> (LC2) 

+  (a2t4)(W)  +  (a2>5)(ATT)  +  (a2>6)(DEL) 

+  (a2>7)(DEL)(FWD)  +  (a2f8) (ONL) (1-A) 

+  (a2,9) (B) (LC2)  +  (a2,10) (W) (LC2) 

+  (a2>n)(DEL)(LC2)  +  (a2,l2)  (ONL)  (1-A)  (LC2) 

+  (a2,13)(8)(FWD)(LC)  +  ( a2 , 14 ) ( 8 ) ( ATT ) ( LC ) 

+  ( a2 , 15 ) ( 8 ) (A) (LC)  +  (a2,l6)(B)(l-A)(LC) 

+  ( a2 ,17 ) (FWD) (ONL) ( 1-A) (LC)  +  ( a2 , 18) (ATT) (ONL ) (A) (LC ) 

+  ( a2, 19) (DEL ) (FWD ) ( 1 -ONL ) (LC )  +  ( a2 . 20 ) ( 8 ) ( W ) (ONL ) ( A ) ( LC ) 

+  ( a2 , 21 ) (B) (W) (ONL ) ( 1-A) (LC)  +  (a2f22) (3) (FWD) (ONL) (A) (LC) 

+  ( a2> 23) (8) (FWD) (ONL ) (A) (LC)  +  (a2>24) (B) (FWD) (ONL) (1-A) (LC) 

+  (a2,25) (B) (ATT) (ONL) (A) (LC)  +  ( a2>26) (3 ) (DEL ) (A) (LC ) 

+  ( a2 , 27 ) (8 ) (DEL ) (FWD) (ONL ) ( 1-A) (LC ) 


y-j  =  output  of  decision;  i.e.,  for  decisions  1  to  3,  it  is  the  criticality 
index  for  assigning  a  new  unit;  for  decision  4,  it  is  posture;  for 
decisions  5  through  8,  it  is  priority  for  CAS  or  CSS 

A  =  1  if  given  online  corps  already  has  a  corps  in  reserve  behind  it 

=  0  is  given  online  corps  has  0  corps  in  reserve 

ATT  =  1  if  posture  is  attack  (and  location  is  forward;  see  Table  4-2) 

=  0  otherwise 

B  =  1  if  given  online  corps  is  engaged 

=  0  if  given  online  orps  is  not  engaged 

DEL  =  1  if  posture  is  delay  (and  location  is  reached  or  forward;  see 
Table  4-2) 

=  0  otherwise 

FE  =  1  if  division  is  assigned  to  first  echelon 
=  0  otherwise 

FWD  =  1  if  location  is  forward  (and  posture  is  delay,  defend,  or  attack; 
see  Table  4-2) 

=  0  otherwise 

G  =  Ratio  of  number  of  corps  artillery  battalions  to  number  of  divisions 

LC  =  Ln  (force  ratio);  i.e.,  natural  logarithm  of  f riendly-to-enemy  force 
ratio  faced  by  given  online  corps 

ONL  =  1  if  corps  is  online 
=  0  if  corps  is  reserve 

RCH  =  1  if  location  is  reach  (and  posture  is  delay  or  defend;  see  Table 
4-2) 

=  0  otherwise 

SE  =  1  if  division  is  assigned  to  second  echelon 
=  0  otherwise 


W  =  1  if  posture  is  withdraw  (and  location  is  rear;  see  Table  4-2) 
=  0  otherwise 


Table  6-1.  Coefficients  for  Regression  Equations 
(page  1  of  2  pages) 
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Variables  Coefficents 


Decision  1 


1 

39.23472 

LC 

-14.97740 

ATT 

25.78958 

A 

-16.96339 

FWD 

7.21597 

FWD-LC2 

-5.12850 

8 

3.37773 

A-LC 

3.87235 

M 

-8.16667 

DEL-RCH 

-5.93333 

Decision  2 

C\j 

31.86248 

B 

16.75298 

LC 

-12.03014 

LC2 

-4.67250 

W 

-17.44812 

ATT 

30.45287 

DEL 

-9.95633 

DEL -FWD 

-4.64445 

ONL-(l-A) 

13.92714 

B  -LC2 

-12.08464 

W-LC2 

10.25807 

DEL-LC2 

5.61111 

ONL  •  ( 1-A) -LC2 

-5.68261 

3 -FWD-LC 

21.61054 

B-ATT-LC 

7.09994 

B-A-LC 

19.42599 

8  -  ( 1-A) -LC 

21.72436 

FWD -ONL • ( 1-A) -LC 

22.22505 

ATT-ONL-A-LC 

23.45383 

DEL -FWD • ( 1-ONL ) • LC 

-27.39868 

8-W-ONL -A-LC 

-16.06599 

3  * W -ONL  * ( 1-A ) -LC 

-26.30630 

3 -FWD -ONL -A-LC 

-13.43161 

B -FWD -ONL • ( 1-A ) -LC 

-44.35901 

3-ATT-OL -A-LC 

-24.71679 

3-DEL-A-LC 

-22.11916 

3  -  DEL -FWD -ONL •( 1-A) -LC 

30.33486 

c 


for  Regress 
2  pages) 


Variables 


Decision  3 


B 

G 

ONL 

ATT 

W 

ONL-B-FWD 


Decision  5 


Decision  6 


Decision  7 


Decision  8 


Coeffi cents 


50.35625 

26.45208 

-14.60000 

11.46042 

7.79375 

-6.27500 

-6.37500 


12.35714 

38.52381 

-8.14890 

14.93651 

-4.75714 


31.12698 

25.74603 

13.04762 

-7.73712 


15.28387 

35.13839 

-3.82305 

9.36667 

22.61667 

■10.74094 


32.67033 

81.3500 

-7.53541 

13.53750 
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(1)  Decision  2.  The  ANOVA  table  (Table  1-10)  indicates  that  many  of 
the  random  effects  are  quite  significant  when  tested  against  the  partial 
replicate  error.  However,  many  of  the  fixed  effects  (main  and  higher-order 
interaction  terms)  are  significantly  different  from  zero.  The  third-order 
interaction  term  8CDE  is  highly  significant.  This  is  a  tipoff  to  problems 
in  finding  a  parsimonious  regression  equation.  In  order  to  assure  an  ade¬ 
quate  model,  27  terms  are  required  in  the  regression  equation  as  measured 
by  Mallows  Cp  statistic.  However,  in  the  model  comparison  table  (Table 
I - 1 1 ) ,  the  difference  in  the  criticality  index  predicted  by  the  regression 
equation  and  the  cell  mean  is  quite  large  for  a  few  cells.  The  largest 
absolute  difference  between  the  regression  equation  and  a  cell  mean  is  13.6 
located  at  priority  number  13  for  the  regression  model.  This  is  still  a 
sizable  difference,  even  though  the  regression  model  is  adequate.  Further¬ 
more,  27  terms  is  25  percent  of  the  terms  represented  by  the  cells  or  the 
fixed  effects  and  interactions  in  the  ANOVA  model.  This  is  hardly  parsi¬ 
monious.  For  these  reasons,  it  is  best  for  this  decision  that  the  cell 
means  be  used  in  a  table  lookup  procedure  rather  than  incorporating  the 
regression  equation  into  FORCEM.  Regarding  the  validity  of  the  current 
rules.  Figure  1-2  is  a  scatter  plot  of  ranking  by  need  generated  by  the 
current  rules  versus  that  generated  by  the  cell  means.  As  with  decision  1, 
the  two  approaches  are  clearly  different. 

(2)  Decision  3.  Corps  posture  is  included  in  this  experiment  (as 
part  of  factor  D)  but  not  in  the  rules  currently  in  FORCEM.  However,  the 
experiment  shows  (see  Table  1-14)  that  posture  is  significant;  i.e.,  it 
should  be  considered  in  making  the  decision.  Also,  because  the  Mallows  Cp 
for  this  experiment  is  greater  than  p  (see  Table  1-3),  the  regression  equa¬ 
tion  is  not  a  fully  satisfactory  representation  of  the  cell  means;  hence,  a 
table  lookup  procedure  using  cell  means  is  the  preferred  method  of  implemen¬ 
tation.  Regarding  the  validity  of  the  current  rules,  Figure  1-3  is  a  scat¬ 
ter  plot  of  ranking  by  need  generated  by  the  current  rules  versus  that  gen¬ 
erated  by  the  cell  means.  As  with  decision  1,  the  two  approaches  are  clearly 
different. 

(3)  Decisions  4  through  8.  The  rules  currently  in  FORCEM  already  use 
lookup  procedures  based  on  input  tables.  Hence  there  is  no  need  to  compare 
the  current  rules  with  the  experimental  data. 

(4)  Decisions  5  through  8.  For  each  such  decision,  the  subject  is 
asked  to  specify  the  priority  for  support  (the  y-j  of  Figures  6-1  and  6-2), 
where  a  higher  value  indicates  higher  priority.  On  the  other  hand,  within 
FORCEM  the  priority  is  used  quantitatively;  it  has  positive  integer  values 
(not  restricted  to  being  less  than  100);  and  a  smaller  value  means  higher 
priority.  For  these  reasons,  neither  the  cell  means  nor  the  prediction 
equations  for  these  decisions  can  be  used  directly.  The  information  con¬ 
tained  in  the  equations,  however,  is  of  use,  as  is  noted  in  paragraph  6-2g 
below.  Lastly,  note  (from  equation  (6-2)  and  Table  5-1)  that  all  terms 
involving  LC  appear  preceded  by  a  minus  sign,  indicating  (as  for  decision 
1)  that  the  subjects  favor  a  unit  with  a  poor  force  ratio  over  one  with  a 
good  force  ratio. 
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g.  Information  on  the  relative  importances  of  the  factors  (i.e,  decision 
variables)  as  perceived  by  the  subjects  can  be  of  use  to  those  who  apply 
FORCEM,  especially  for  decisions  5  through  8  where  the  regression  equations 
cannot  be  used  directly.  For  most  of  the  regression  equations  in  Figure 
6-1,  the  presence  of  interaction  terms  makes  it  impossible  to  assess  rel¬ 
ative  importances.  Decisions  6  and  8  are  fortunate  exceptions;  the  relative 
importances  of  the  factors  for  these  decisions  can  be  determined  and  are 
shown  in  Figure  6-3.  For  decision  5,  engagement  status  is  preeminent,  but 
the  relationship  between  assigned  echelon  and  force  ratio  is  less  clear. 
Decision  7  is  even  less  amenable  to  this  type  of  analysis. 


•  Decision  6--Specif ication  of  priority  to  corps  for  CSS 

••  Engagement  status 
••  Online  or  reserve 
m  Force  ratio 


Decision  8--Specif ication  of  priority  to  division  for  CSS 

••  Engagement  status 
••  Assigned  echelon 
••  Force  ratio 


Figure  6-3.  Relative  Importance  of  Decision  Criteria 


6-3.  SECOND  APPROACH.  Decision  4,  Designation  of  Posture  of  Online  Corps, 
must  be  treated  differently  from  the  other  decisions  because  it  involves  an 
order  categorical  response  variable.  The  response  variable  is  posture. 

The  subject  is  required  to  choose  the  most  appropriate  posture  for  a  given 
set  of  input  factors.  The  choice  is  attack,  defend,  delay,  or  withdraw. 

The  factors  take  on  the  same  character  as  in  the  first  approach  giving  a 
structure  on  which  to  base  the  experiment.  The  factors  C,  M,  and  N  are 
described  in  Table  4-2,  and  the  levels  are  shown  in  Table  4-3.  In  FORCEM, 
a  definite  posture  must  be  assigned  to  a  corps  given  a  set  of  factor  levels. 
This  is  a  deterministic  choice  versus  a  stochastic  choice  as  in  most  analytic 
modeling  techniques.  An  approach  to  dealing  with  this  statistically  is  to 
test  each  cell  with  a  simple  statistical  hypothesis  test.  For  each  of  the 
27  cells,  the  null  hypothesis  for  the  cell  is  that  less  than  half  of  the 
expert  population  chooses  any  one  of  the  postures.  The  alternate  hypothesis, 
the  statement  desired  for  the  cell,  is  that  more  than  half  of  the  expert 
population  chooses  one  common  posture;  i.e.,  a  "majority"  posture.  The 
test  takes  the  form  of  Hg:  p  <  0.5  and  H/\:  p>0.5.  The  random  variable  X-j 
( i  =  1  to  81,  for  sample  of  31  expert  subjects)  takes  on  the  value  1  when  a 
subject  picks  the  posture  with  largest  number  of  responses  (i.e.,  the 
"favored"  posture)  in  the  cell  under  consideration;  the  probability  that 
X-j  =  1  is  p.  The  random  variable  Xi  takes  on  the  value  0  if  the  subject 
picks  any  other  posture;  the 


probability  that  Xi  =  0  is  (1  -  p).  If  there  is  a  tie  for  the  favored  pos¬ 
ture,  the  test  cannot  logically  result  in  a  rejection  of  the  null  hypothesis 
Assuming  there  is  a  favored  posture,  a  test  must  be  constructed  to  decide 
whether  to  (1)  reject  the  null  hypothesis  or  (2)  not  reject  the  null  hypoth¬ 
esis  because  of  insufficient  evidence  to  the  contrary.  The  appropriate 
distribution  is  the  distribution  of  the  sum  of  the  random  variables  X  j . 

This  is  the  binomial  distribution  with  parameters  N  =  31  and  p  =  0.5.  A 
critical  region  must  then  be  determined  for  which  the  null  hypothesis  is 
rejected  when  in  fact  true  with  no  more  than  a  stated  probability.  This 
probability  is  referred  to  as  alpha,  the  significance  level  of  the  test. 
Typically  a  value  of  alpha  =  0.05  is  taken;  for  the  case  under  consideration 
the  critical  region  corresponds  to  a  count  of  responses  of  K  =  48.  For 
alpha  =  0.01,  K  =  52.  On  this  basis,  the  count  for  each  of  the  27  cells  is 
tested  in  the  hope  of  rejecting  the  null  hypothesis.  Table  6-2  displays 
the  results  of  the  test.  The  favored  posture  is  designated  in  the  cell  for 
the  given  levels  of  the  factors  C,  M,  and  N.  The  number  of  subjects  of  the 
total  of  81  choosing  the  posture  is  indicated  in  parentheses.  Double  aster¬ 
isks  **  indicate  that  the  null  hypothesis  can  be  rejected  at  the 
alpha  =  0.01  level  of  signif icance,  and  a  single  asterisk  *  indicates  that 
the  null  hypothesis  can  be  rejected  at  the  alpha  =  0.05  level.  For  the 
remaining  cells  (those  without  asterisks),  there  is  insufficient  evidence 
to  reject  the  null  hypothesis;  indeed,  as  noted  in  the  table,  for  some  cells 
there  is  no  favored  posture. 


Table  6-2.  Decision  4  "Favored"  Postures 

1 


Posture  Location  of  objective 

of  parent  Force  . -  . . .  . 

army  ratio  Rear  Reached  Forward 


Delay 

1:3 

Del  ay 

(51)* 

Defend 

(42) 

Defend 

(56)** 

1:1 

Delay 

(47) 

Defend 

(46) 

Defend 

(51)* 

3:1 

Del  ay 

(31)# 

Defend 

(39)# 

Attack 

(58)** 

Defend 

1:3 

Defend 

(37)# 

Defend 

(72)** 

Defend 

(68)** 

1:1 

Defend 

(47) 

Defend 

(70)** 

Defend 

(52)** 

3:1 

Defend 

(38)# 

Defend 

(53)** 

Attack 

(70)** 

Attack 

1:3 

Defend 

(59)** 

Defend 

(51)** 

Defend 

(51)* 

1:1 

Defend 

(53)** 

Defend 

(49)* 

Attack 

(43) 

3:1 

Attack 

(52)** 

Attack 

(67)** 

Attack 

(31)** 

Key: 

*:  significant  at  alpha  =  0.05 
**:  significant  at  alpha  =  0.01 
#:  no  majority  posture 
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Note  that  the  following  set  of  rules  can  be  inferred  from  the  data: 

If  army  posture  is  delay,  then  corps  posture  is  -- 

Delay  when  objective  is  to  rear, 

Attack  when  objective  is  forward  and  force  ratio  is 
at  least  3:1,  and 
Defend  in  all  other  cases. 

If  army  posture  is  defend,  then  corps  posture  is  -- 

Attack  when  objective  is  forward  and  force  ratio 
is  at  least  3:1,  and 
Defend  in  all  other  cases. 

If  army  posture  is  attack,  then  corps  posture  is  -- 

Attack  when  force  ratio  is  at  least  3:1, 

Attack  when  objective  is  forward  and  force  ratio 
is  at  least  1:1,  and 
Defend  in  all  other  cases. 

From  the  structure  of  the  test  and  the  responses  of  the  subjects,  certain 
other  patterns  emerge. 

a.  The  response  "withdraw"  is  not  selected  as  the  largest  response  for 
any  of  the  27  cells.  It  can  be  assumed  by  the  structure  of  the  responses 
that  "withdraw"  could  only  apply  with  a  friendly-to-enemy  force  ratio  of 
less  than  1:3. 

b.  When  the  posture  of  the  parent  army  is  attack,  only  one  cell  at  the 
level  of  factors  chosen  is  indeterminant  (i.e.,  force  ratio  =  1:1,  location 
=  forward).  This  seems  to  indicate  an  unidentified  defend/attack  threshold 
somewhere  between  this  cell  and  the  cell  for  force  ratio  =  1:3,  location  = 
forward. 

c.  When  the  posture  of  the  parent  army  is  defend  or  delay,  and  the  loca¬ 
tion  of  the  objective  is  forward,  an  attack/defend  threshold  appears  to  lie 
between  force  ratios  of  1:1  and  3:1. 


d.  When  the  posture  of  the  parent  army  is  defend  and  the  location  of 

the  objective  is  to  the  rear,  the  majority  posture  may  be  difficult  to  estab¬ 
lish.  The  largest  number  of  responses  are  defend.  For  force  ratio  1:3  and 
1:1,  delay  is  a  close  alternative  with  32  and  25  responses,  respectively. 

At  force  ratio  3:1,  there  is  a  tossup  for  second  alternative  between  delay 
and  attack  with  17  responses  each. 

e.  When  the  posture  of  the  parent  army  is  delay  and  the  location  of  the 
objective  is  reached,  or  both  the  location  is  rear  and  the  force  ratio  is 
at  least  1:1,  then  the  majority  posture  may  be  difficult  to  establish. 


.V.'.'.VA.N 
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CHAPTER  7 

FINDINGS  AND  RECOMMENDATIONS 


7-1.  FINDINGS 

a.  The  most  important  product  of  this  study  is  the  methodology--"off- 
line"  experiments  with  subjects  acting  as  decisionmakers,  followed  by 
statistical  analysis.  This  methodology  can  be  used  to  develop  rules 
initially  or  to  modify  existing  rules. 

b.  Based  on  the  experiments,  it  can  be  concluded  that  for  each  decision 
listed  in  Table  1-1,  Chapter  1,  all  of  the  perception  data  base  variables 
used  in  the  rules  currently  in  FORCEM  are  significant;  i.e.,  relevant  to 
the  decision.  This  conclusion  must  be  caveated,  however,  since  only  those 
variables  are  referenced  in  the  experiments.  Were  additional,  relevant 
variables  to  be  introduced,  it  is  conceivable  that  some  of  the  variables  in 
the  current  rules  would  become  less  significant. 

c.  For  decisions  1,  5,  6,  7,  and  8,  the  cell  means  shown  in  Tables  1-4, 
1-16,  1-20,  1-24,  and  1-28  of  Appendix  I  adequately  represent  the  choices 
of  the  subjects;  so  also  do  the  prediction  equations  displayed  in  Figure 
6-1  and  Table  6-1.  For  decisions  2  and  3,  the  cell  means  shown  in  Tables 
1-8  and  1-12  of  Appendix  I  adequately  represent  subjects'  choices.  For 
decision  4,  the  "favored"  postures  of  Table  6-2  show  subjects'  preferences. 

d.  Regarding  the  validity  of  the  rules  currently  in  FORCEM,  for  deci¬ 
sions  1,  2,  and  3,  the  ranking  by  need  generated  by  the  cell  means  differs 
clearly  from  the  ranking  generated  by  the  current  rules.  This  indicates 
that  the  rules  could  be  replaced  with  table  lookup  procedures  based  on  the 
cell  means  in  order  to  obtain  "better"  decisions.  However,  the  limited 
experience  of  the  subjects  in  decisionmaking  at  the  echelons  considered  in 
the  experiments,  and  the  lack  of  knowledge  of  the  subjects  about  FORCEM 
itself,  argue  for  great  caution  in  accepting  the  cell  means  data  as  gospel 
and  applying  such  data  in  FORCEM.  In  summary,  the  experiments  for  deci¬ 
sions  1,  2,  and  3  do  not  validate  the  rules  currently  in  FORCEM;  but  the 
experiments  do  not  invalidate  the  rules  either.  Regarding  decisions  4 
through  8,  the  decisions  in  FORCEM  are  already  made  using  table  lookup 
procedures;  the  experiments  yield  no  additional  information  on  the  validity 
of  these  decisions. 
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e.  As  suggested  by  subjects  in  written  comments  on  the  post-experiment 
questionnaires,  and  by  Red  experts  in  discussions,  there  are  shortcomings 
to  the  representation  of  in  FORCEM.  Brief  titles  indicating  the  general 
areas  of  the  shortcomings  are  shown  in  Figure  7-1.  More  detailed 
descriptions  are  given  in  Appendix  J. 


•  Contingent  change  in  posture 

•  Holding  arriving  division 

•  Echelon  at  which  decision  made 

•  Artillery  support 

•  AirLand  battle 

•  Personnel  issues 

•  Time  in  combat  and  rate  of  loss 

•  Breakthrough 

•  Weather 

•  Overall  consideration  of  time 

•  Combat  reserves 

•  0P0R0ER  methodology 


Figure  7-1.  Shortcomings  in  FORCEM 


f.  In  their  written  comments  on  the  post-experiment  questionnaires, 
subjects  suggest  several  variables  for  use  as  decision  criteria  that  are 
not  currently  in  the  FORCEM  perception  data  base.  These  are  listed  in 
Figure  7-2.  Appendix  K  describes  these  variables  more  fully  and  indicates 
how  they  might  be  computed  within  FORCEM. 


•  Rate  of  loss  for  friendly  forces 

•  Rate  of  loss  for  enemy  forces 

•  Time  in  sustained  combat  for  friendly  forces 

•  Time  in  sustained  combat  for  enemy  forces 

•  Geographical  momentum 

•  Projected  rate  of  movement 

•  Number  of  divisions  that  can  be  placed  in  area 

•  Status  of  artillery  support 

•  Status  of  CAS 

•  Control  of  air 

•  Enemy  posture 


Figure  7-2.  Additional  Perception  Data  Base  Variables 
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g.  In  their  written  comments  on  the  post-experiment  questionnaires, 
subjects  suggest  the  use  of  additional  decision  criteria  in  making  specific 
decisions.  Figure  7-3  displays  these  suggestions,  with  the  format  of  the 
decision  followed  by  a  list  of  existing  perception  data  base  variables  to 
be  used  as  decision  criteria  for  that  decision  over  and  above  the 
perception  data  base  variables  used  in  the  rules  currently  in  FORCEM. 
Appendix  L  explains  these  suggestions  in  greater  detail. 


•  Assignment  of  new  field  artillery  battalion 


••  Posture  of  potential  receiving  corps 
••  Status  of  divisional  field  artillery 


•  Designation  of  posture  of  online  corps 
••  Terrain 

••  Status  of  associated  corps  support  complex 
••  Information  on  neighboring  online  corps 

•  Priority  to  corps  (or  division)  for  CAS 

••  Posture  of  corps  (or  division) 

••  Adequacy  of  recent  CAS  support 

•  Priority  to  corps  (or  division)  for  CAS 


•• 

•• 


Posture  of  corps  (or  division) 

Current  CSS  status  of  associated  corps  support 
complex  (or  of  division  and  associated  division 
support  complex) 


Figure  7-3.  Expanded  Criteria  for  Decisions 
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7-2.  RECOMMENDATIONS 

a.  For  testing  purposes,  table  lookup  procedures  snould  be  installed  in 
FORCEi-l  for  decisions  1,  2,  and  3.  Then  testing  should  be  conducted  to 
assess  the  reasonableness  of  the  outcomes  of  the  decisions  when  the  data 
from  this  study  are  used;  namely,  the  cell  means  data  in  Tables  1-4,  1-8, 
1-12,  1-16,  I-2C,  1-24,  and  1-28  of  Appendix  I,  and  the  favored  posture 
data  in  Table  6-2  of  Chapter  6.  In  preparing  the  input  data  for  decisions 

5  through  8,  each  entry  in  the  cell  means  tables  (Taoles  1-16,  1-20,  1-24, 
and  1-28)  must  be  converted  judgmental ly  from  the  qualitative  ranking  scale 
0  to  100  to  the  quantitative  apportioning  scale  °o  to  1,  as  discussed  in 
paragraph  6-2f(4),  Chapter  6. 

b.  Acid  the  variables  in  Figure  7-2  to  the  FORCEM  perception  data  base. 

c.  Perform  in-house  experiments  for  the  decisions  shown  in  Figure  7-3 
in  order  to  determine  how  to  best  utilize  the  suggested  expanded  set  of 
decision  criteria. 

d.  The  primary  focus  of  this  study — decision  rules  in  FORCEM--and  the 
approach  taken  considering  the  rules — off  1 ine  experiments  based  on  the 
decisions--yield  little  information  regarding  the  use  of  FORGE. 
Nevertheless,  the  techniques  for  gathering  data  for  this  study  can  be 
adapted  to  yield  methods  for  recording  FORGE  gamers'  decisions.  The 
following  two  suggestions  are  offered: 

(1)  For  the  near  term,  prepare  a  brief  questionnaire  for  use  with 
each  of  the  16  FORGE  decisions.  The  questionnaire  would  be  completed  by  a 
gamer  at  the  completion  of  interactive  activities  during  an  interrupt 
wherein  the  gamer  made  a  decision  of  that  form.  It  would  solicit  the  data 
items  used  in  making  the  decisions,  with  the  items  grouped  into  the 
categories  shown  in  paragraphs  7-2d(l)(a)  through  7 -2d ( 1 ) ( d )  below. 
Furthermore,  the  gamer  would  be  asked  to  rank  the  items  by  importance. 

(a)  Perception  data  base  variables  used  in  the  rules  currently  in 
FORCEM.  These  would  be  listed  explicitly,  with  a  simple  "yes"  or  "no" 
sought. 

(b)  Perception  data  base  variables  suggested  in  Figure  7-3,  should 
the  decision  be  one  of  the  four  listed  there.  Again,  the  variables  would 
be  listed  explicitly,  with  a  simple  "yes"  or  "no"  sought. 

(c)  Graphics  display,  with  an  associated  request  for  written 
explanation  for  what  graphics  information  was  used. 

(d)  Other  data,  with  a  request  for  a  written  list  of  such  data 

i terns. 
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(2)  For  the  longer  term,  develop  software  to  solicit  the  necessary 
data  items  from  the  gamer  in  an  interactive  manner.  At  the  completion  of 
‘interactive  gamer  entries,  save  gamer  decisions,  then  when  FORCEM  is 
reactivated  keep  the  gamer  workstation  active  and  present  the  question¬ 
naires  discussed  above  to  the  gamer  on  the  menu  screen  for  completion 
interacti vely. 

e.  Whether  and  how  to  use  FORGE  to  validate  and  enhance  the  decision 
rules  in  FORCEM  should  be  topics  for  future  study. 

f.  Based  on  review  of  the  results  of  the  experiments  and  on  the  written 
comments  by  the  subjects,  the  following  suggestions  are  offered  for 
approaches  to  be  taken  should  studies  similar  to  this  one  be  contemplated: 

(1)  Availability  of  Knowledgeable  Person.  When  US  Army  officers  are 
asked  to  provide  answers  to  questions  related  to  computer  models,  informa¬ 
tion  on  the  model  and  the  associated  concepts  should  be  available  to  the 
subjects.  This  was  done  for  this  study  by  providing  a  background  informa¬ 
tion  paper  for  each  of  the  experiments.  Based  on  the  subsequent  written 
comments  of  the  subjects,  this  approach  was  insufficient.  It  would  be  well 
to  ensure  that  when  such  an  experiment  is  administered,  a  person  who  knows 
the  model  in  depth  is  present  to  answer  questions. 

(2)  Use  of  Familiar  Terminology.  Certain  concepts  used  in  computer 
models  are  adaptations  of  concepts  more  familiar  to  US  Army  officers;  the 
intended  meanings  of  the  model  concepts  can  be  lost  in  an  experiment  refer¬ 
encing  them.  For  example,  in  this  study,  the  subjects  objected  to  the  use 
of  the  terms  "echelon,"  "posture,"  and  "army  objective  phase  line."  Pro¬ 
viding  background  material  describing  the  intended  meaning  of  model  con¬ 
cepts  is  one  approach  to  preventing  potential  confusion.  Another  method  is 
to  make  every  effort  to  use  terminology  familiar  to  the  subjects  when 
describing  the  concepts.  The  latter  approach  is  appropriate  in  a  larger 
context  whenever  briefings  on  the  model  are  given. 

(3)  Benchmark  Values.  When  an  experiment  is  administered  wherein  the 
subject  is  asked  to  provide  a  "grade"  or  "rank"  to  each  of  a  number  of  situ¬ 
ations  generated  by  varying  one  or  more  decision  variables,  the  full  ranges 
of  the  decision  variables  should  be  described;  or  a  "benchmark"  example 
should  be  given  to  the  subject  before  the  experiment  ( i . e . ,  a  sample  with  a 
suggested  grade).  This  prevents  the  grade  assigned  by  the  subject  for  an 
early  situation  from  precluding  consistent  assignment  of  grades  for  subse¬ 
quent  situations  (possibly  more  extreme  than  the  early  one). 
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APPENDIX  A 
STUDY  CONTRIBUTORS 


1.  STUDY  TEAM 

a.  Study  Director 

Dr.  James  J.  Metzger 

b.  Team  Members 

Mr.  Carl  F.  Bates 
Mr.  Franklin  E.  Womack 
Mr.  Ronald  B.  Bonniwell 
Mr.  Thomas  C.  Johnson 


2.  PRODUCT  REVIEW  BOARD 

a.  Chairperson 

Mr.  Ronald  J.  Iekel 

b .  Members 

MAJ  Berner  R.  Johnson,  Jr. 
Mr.  James  S.  Tesauro  (Co-Op) 
MAJ  Glen  R.  White 


3.  EXTERNAL  CONTRIBUTORS 

a.  Dr.  Sam  Parry,  a  professor  at  the  Naval  Postgraduate  School.  As  a 
visiting  analyst  at  the  US  Army  Concepts  Analysis  Agency,  Dr.  Parry 
developed  the  concept  for  combining  expert  judgment  and  statistical  analy¬ 
sis  as  a  means  of  enhancing  the  representation  of  command  and  control  in 
FORCEM,  and  thereby  provided  the  basic  structure  for  the  study. 

b.  CPT  Douglas  Fletcher,  a  student  at  the  Naval  Postgraduate  School. 
During  an  experience  tour  at  CAA,  he  implemented  in  FORCEM  and  tested  the 
prediction  equation  resulting  from  the  pretest  on  Decision  1,  Assign  New 
Corps. 


c.  Mr.  Dennis  leedom,  Assistant  Director,  Systems  Research  Laboratory, 
US  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences,  devel¬ 
oped  the  questionnaire  shown  in  Appendix  D  and  compiled  the  summary  of 
responses  shown  in  Appendix  F. 
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1  5  AUG  1985 


MEMORANDUM  FOR  ASSISTANT  DIRECTOR,  AS 

1'JBJECT:  C^  Enhancements  for  FORCEM  (CENFOR)  Study 


1.  PURPOSE.  This  directive  provides  tasking  for  a  study  to  develop  and  apply 
methodologies  for  validating  and  enhancing  the  command  and  control  (C^) 
decision  rules  in  the  Force  Evaluation  Model  (FORCEM). 

2.  BACKGROUND 

a.  FORCEM  is  a  fully-automated  computer  model  treating  combat,  combat 
support,  and  combat  service  support  in  a  theater.  C^  is  represented  through  a 
specified  set  of  decisions  treated  in  a  predetermined  order.  Each  decision 
involves  the  application  of  embedded  rules  based  on  preselected  information 
from  the  perceived  data  base.  The  only  control  available  to  the  user  is  the 
designation  of  threshold  values  to  which  data  from  the  perceived  data  base  are 
compared. 

b.  The  FORCEM  Gaming  Evaluator  Model  (FORGE)  is  an  interactive  version  of 
FORCEM  being  developed  under  contract  to  allow  gamers  to  direct  the  overall 
pattern  of  a  particular  situation  by  making  many  of  the  key  decisions.  Those 
decisions  constitute  a  subset  of  the  decisions  made  in  an  automated  manner  by 
FORCEM.  In  making  each  decision,  a  gamer  is  to  have  available  the  information 
in  the  perceived  data  base  (not  just  the  data  used  in  the  rules  embedded  in 
FORCEM)  plus  graphics  displays. 

c.  The  objectives  of  FORGE  are  as  follows: 

(1)  To  validate  and  enhance  the  current  decision  rules  in  FORCEM. 

(2)  To  provide  an  alternative  to  the  McClintic  Theater  Model /Joint 
Theater  Level  Simulation  for  evaluation  of  large  scale  operation'  plans. 

(3)  To  provide  a  training  model  for  users  such  as  the  Army  Mar 
College  and  the  Naval  Postgraduate  School. 

(4)  To  generate  scenarios  for  users  such  as  the  Warrior  Preparation 

Center. 

d.  FORGE  provides  a  valuable  tool  to  evaluate  the  automated 
representation  of  in  FORCEM. 

3.  STUDY  SPONSOR.  US  Army  Concepts  Analysis  Agency  (CAA). 

4.  STUDY  AGENCY.  Models  Development  Division,  Analysis  Support  Directorate 
(AS),  CAA. 
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CSCA-ASO 

SUBJECT:  C2  Enhancements  for  FORCEM  (CENFOR)  Study 


5.  TERMS  OF  REFERENCE. 

a.  Scope.  This  study  is  limited  to  developing  and  applying  methods  for 
validating  and  enhancing  the  decision  rules  in  FORCEM,  using  FORGE  as  an 
experimental  environment. 

b.  Objectives. 

(1)  To  develop  and  apply  methodologies  to  — 

(a)  Examine  specific  decisions  using  scenarios  extracted  from 
FORCEM  or  FORGE,  including  selected  data  from  the  perceived  data  base  and 
graphics  displays, 

(b)  Prepare  and  exercise  ''offline”  experiments  based  on  the 
scenarios,  and 

(c)  Apply  the  information  collected  from  the  experiments  to 
validate  and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies 
for  use  during  the  actual  exercise  of  FORGE. 

(2)  To  develop  methodologies  to  — 

(a)  Record  gamer  decision  processes  during  the  exercise  of 

FORGE,  and 

(b)  Use  the  information  collected  from  gamers  to  validate  and 
enhance  the  decision  rules  in  FORCEM. 

(3)  Make  recommendations  for  actual  exercises  of  FORGE  using  the 
methodologies  of  5b ( 2 )  above. 

c.  Assumption :  FORCEM  provides  an  adequate  context  for  examining  C2 
issues  at  echelons  above  division. 

d.  Essential  Elements  of  Analysis 

(1)  Are  the  decisions  currently  represented  in  FORCEM  appropriate  for 
a  theater-level  model? 

(2)  For  each  decision,  what  are  the  critical  data;  i.e.,  what  are  the 
pertinent  data  items  from  the  perceived  data  base? 

(3)  Are  the  decision  rules  embedded  in  FORCEM  appropriate?  If  not, 
how  should  they  be  expanded  or  modified? 
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SUBJECT:  Enhancements  for  FORCEM  (CEMFOR)  Study 


6.  RESPONSIBILITIES 

a.  Analysis  Support  Directorate  (AS)  has  primary  responsibility  for 
accomplishment  of  the  objectives  listed  in  paragraph  5b.  It  will  provide  the 
study  director.  It  will  extract  scenarios  from  FORCEM  for  use  in  offline 
experiments.  It  will  direct  offline  experiments  using  scenarios  derived  from 
FORCEM  or  FORGE. 


b.  All  CAA  directorates  will  provide  officers  to  serve  as  players  in 
offline  experiments.  Strategy,  Concepts,  and  Plans  Directorate  (SP)  will  also 
provide  technical  advice  and  assistance  in  extracting  scenarios  from  FORGE  for 
use  in  offline  experiments. 

c.  Management  and  Support  Directorate  (MS)  will  provide  the  CAA  Red  Team 
to  validate  methodology  and  rules  concerning  Red  decisions. 

d.  The  US  Army  Research  Institute  for  tfre  Behavioral  and  Social  Sciences 
(ARI)  will  provide  consulting  assistance  in  selecting  information  from  FORCEM 
or  FORGE  for  use  in  offline  experiments,  and  in  designing  methods  for 
recording  gamer  decision  processes  during  the  actual  exercise  of  FORGE. 

7.  LITERATURE  SEARCH.  The  following  documents  will  be  utilized  in  the  study. 


a.  "Conmand  and  Control  in  the  Force  Evaluation  Model,"  CAA  Technical 
Paper  CAA-TP-84-8,  Jun  84. 

b.  "Command  and  Control  in  the  Force  Evaluation  Model,"  Internal  CAA 
Document,  Feb  85. 

c.  "Interactive  Theatre  Wargame  (FORGE),  Program  Specification  (PS)," 
Harris  Corporation,  Apr  85. 

3.  REFERENCES 


a.  AR  5-5,  Army  Studies  and  Analyses,  Nov  81. 

b.  DA  PAM  5-5,  Guidance  for  Army  Study  Sponsors,  Sponsor's  Study 
Directors,  Study  Advisory  Groups,  and  Contracting  Officer  Representatives,  Apr 
32. 


9.  ADMINISTRATION 

a.  Milestone  Schedule.  See  CAA  Form  59  (Enclosure  1). 
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CSCA-ASD 
SU8JECT : 


Enhancements  for  FORCEM  ( CENFOR )  Study 


b.  Reporting.  Models  Development  Division,  AS,  will  submit  DD  Forms  1498 
and  1473  to  the  Defense  Technical  Information  Center,  in  accordance  w- th  AR  5- 
5  and  DA  PAM  5-5. 

c.  Documentation.  The  methodology  developed,  conclusions  drawn,  and 
recommendations  made,  will  be  documented  in  a  final  report. 


Enel 


CF: 

Asst  Dir,  FO 
Asst  Dir,  FS 
Asst  Dir,  MS 
Asst  Dir,  RQ 
Asst  Dir,  SP 


r.  ^ 


E.  B.  VANDIVER  III 
Di rector 
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APPENDIX  C 
INFORMATION  PAPERS 


This  appendix  contains  copies  of  the  information  papers  provided  to  CENFOR 
subjects  prior  to  the  experiments.  Corresponding  to  each  experiment  is  an 
information  paper  that  describes  FORCEM,  the  decision  being  made,  and  the 
variables  from  the  perception  data  base  that  are  used  in  the  rules  currently 
in  FORCEM  and  are  to  be  controlled  and  varied  in  the  experiment. 
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ign  new  c  cups 


A ■  GENERAL. 


Twe  force  Evaluation  "odel  (fCRcE*)  is  a  comauttr 
simulation  develooed  by  the  U?  Army  Concepts  Analysis 
Agency.  It  treats  combat,  comoat  upport,  and  ccutat 
service  support  (($')  in  a  theater  of  operations. 

Activities  are  represented  at  four  ecf-elcns:  theater,  army, 

corps,  and  division  (in  US  terminology).  The  primary  unit 
for  combat  is  the  a i vis  ion.  The  representation  of  command 
ana  control  ((2)  is  f u l l y -a u t om a t e d .  for  each  theater, 
army,  ano  corps  headquarters  (HOS),  decisions  are  made 
internally  ty  ICSCE"  about,  or  that  directly  affect, 
immediate  suborainates.  Thus,  for  example,  an  army  wQ$ 
assigns  a  oriority  for  CSS  to  each  of  its  subordinate 
corps'.  'or  each  decision  for  a  MQS,  there  is  a  set  of 
rules  encoded  into  fCBCEm  that,  in  turn,  reference  a 
predetermined  set  of  parameters  from  the  "perception 
catabase"  (containing  perceived  information  about  the  hQS 
itself,  its  subordinates  ,  ana  enemy  forces),  and  that  apply, 
as  veil,  input  threshold  parameters. 


The  purpose  of  this  e«periment,  and  of  the  subseauent 
statistical  analysis  to  be  performed  on  the  results,  is  to 
validate,  an  possibly  enhance,  the  representation  of  one 
such  decision  oy  determinino — 

1.  .Itether  the  parameters  currently  used  from  the 
perception  database  are  necessary  and  proper,  ano  if  so,  how 
they  should  be  comoined  in  making  the  decision. 

2.  whether  additional  information  is  relevant,  and 
should  be  added  to  the  list  of  parameters  used  in  the 
decision. 


The  experiment  itself  will  be  administered  on  the  VAX 
minicomputer.  After  the  experiment,  a  Questionnaire  will  be 
provided  to  be  completed  in  handwritten  form;  it  will  also 
assist  in  achieving  the  above  aoal. 


SPECIFIC . 


The  topic  of  this  experiment  is  the  decision  on 
assignment  of  a  nevly  arrivta  corps.  Such  a  corps  t.ith  its 
subordinate  oivisions)  may  enter  the  theater  after  the 
beginning  of  tne  simulation.  ]  f  the  corps  is  not 
preassigned  by  the  user  to  an  existing  army,  and  further  to 
reserve  status  Dehioo  an  existing  online  corps,  then  logic 
internal  to  f  0  A  (  E  M  does  so.  (Another  decision  in  FORCE'’’, 
net  considered  in  this  experiment,  involves  subseauent 
commitment  to  combat  of  the  reserve  corps.) 


lhe  mechanism  used  in  determining  the  online  corps 
behind  which  the  newly  arrived  corps  is  to  be  assigned  in 
reserve  involves  ranking  the  potential  receiving  online 
corps'  by  need,  ano  then  selectino  the  online  coros  with  the 
greatest  need.  The  need  of  an  online  coros  is  specified  by 
a  numerical  criticality  that  is  computed  based  on  the 
perception  database  parameters  shown  below.  These  are  tie 
parameters  to  be  varied  in  the  experiment. 

1 .  whether  the  online  corps  currently  has  no  reserve 
corps  behind  it,  or  Currently  has  one  or  more  reserve  corps' 
behino  it.  (for  tie  experiment,  read  “one  corps  in  reserve” 
to  mean  "one  or  more  corps'  is  reserve".) 

c.  „ h e * h e r  or  not  the  online  coros  is  encaged. 
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i.  the  location  of  the  parent  army's  objective  chase 
line  relative  to  the  location  of  the  online  cores.  the  army 
objective  phase  line  designates  the  desired  locations  to  be 
reacheo  lor  helo)  cy  subordinate  online  corps'  within  the 
army,  ana  is  input  to  fORCEM  by  the  user.  (The  term 
“forward  control  Phase  tine  of  a  corps"  is  also  used;  this 
is  an  internal  model  artifice  tor  controlling  the  movement 
of  subordinate  divisions.  'or  the  ourposes  of  this 
e»periment,  read  " forwarc  control  phase  line  of  a  corps"  to 
mean  “location  of  the  corps"  to  mean  "location  of  the  most 
'orward  division  in  the  coros".)  The  army  objective  phase 
line  can  be  "forward"  of  the  tocation  of  the  online  corps, 
"at"  the  location  of  the  online  corps,  or  "to  the  rear"  o* 
the  location  of  the  online  corps. 


C.  The  posture  of  the  online  coros  li.e.,  attach, 
aefend,  delay,  or  withdraw).  The  posture  is  the  mission 


assigned  to  the  online 


its  parent  army  hQS. 


5.  The  f r  i  e nd l y -f o-e ne m y  force  ratio  faced  oy  the 
online  corps,  as  perceives  by  the  parent  army  riQS. 


CAA-SR-86-5 
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A  .  6  E  N  E  K  *  U  . 


The  force  Evaluation  model  (TPHeE")  is  a  computer 
simulation  develooed  oy  the  U5  »rmy  Concepts  Analysis 
Aqency.  It  treats  compat,  combat  supoorti  and  combat 
service  support  < C S S  )  in  a  theater  of  operations. 

Activities  are  represented  at  four  echelons:  theater,  army, 

corps,  and  division  (in  US  terminology).  The  primary  unit 
tor  combat  is  the  division.  The  r e p r e s e n t a t  i  on  of  command 
and  control  ( C  2  )  is  fully-automated.  for  each  theater, 
army,  and  corps  headauarters  (HQS),  decisions  are  made 
internally  by  fCfi(EM  about,  or  that  directly  affect, 
immeoiate  s ub o ro i na t e s .  Thus,  for  example,  an  army  HdS 
assigns  a  priority  for  (SS  to  each  of  its  subordinate 
corps'.  for  each  decision  for  a  hq$,  there  is  a  set  of 
rules  encoded  into  f 0 # C f "  that,  in  turn,  reference  a 
p red e t e rm i n ed  set  of  parameters  from  the  "perception 
cataoase"  (containing  perceived  information  about  the  hGS 
itself,  its  suoo r d  i  na t e s  ,  ano  enemy  forces),  and  that  apply, 
as  well,  input  threshold  parameters. 


The  purpose  of  this  experiment,  and  of  the  subseauent 
statistical  analysis  to  be  performed  on  the  results,  is  to 
validate,  an  possibly  enhance,  the  representation  of  one 
such  decision  by  determ inino-- 

1.  whether  the  parameters  currently  used  from  the 
perception  database  are  necessary  and  proper,  ano  if  so,  how 
they  should  be  combined  in  making  the  decision. 

2.  whether  additional  information  is  relevant,  ana 
should  be  added  to  the  list  of  parameters  used  in  the 
cecis i on . 


The  experiment  itself  will  be  administered  on  the  va» 
minicomputer.  After  the  experiment,  a  questionnaire  will  be 
provided  to  be  completed  in  handwritten  form;  it  will  also 
assist  in  achieving  the  above  goal. 


SFE  C 1 f 1 (  . 


The  topic  of  this  experiment  is  the  decision  on 
assignment  of  a  newly  arrived  division.  ?uch  a  division  may 
enter  the  theater  after  the  beginning  of  the  simulation.  If 
the  division  is  not  preassioned  by  the  user  to  in  existing 
(or  newly  arriving)  corps,  then  logic  internal  to  F 0 « ( E y 
Goes  so. 


The  mechanism  used  in  determining  the  corps  to  which  the 
newly  arriv'd  division  is  to  be  assigned  involves  rank  in., 
the  potential  receiving  corns'  by  need,  and  then  selecting 
the  corps  with  the  greatest  need.  The  need  of  a  corps  is 
soecifiea  by  a  numerical  criticality  thit  is  computed  ba.ed 
on  the  perception  aatabase  parameters  shown  below.  These 
.re  the  parameters  to  be  varied  in  the  experiment. 

t.  whether  the  existing  corps  is  online  or  reserve. 

2.  1*  online,  the  number  of  reserve  corps'  „ehind  it; 

if  reserve,  echelon  to  which  it  is  ass  Toned. 

1.  whether  or  not  the  corps  is  engaged. 

w.  The  location  of  the  parent  irmy's  objective  phase 
line  relative  to  tn»  location  of  the  corps.  The  i  my 
opjective  phase  line  designates  the  desired  locations  to  he 
reached  (or  held)  oy  subordinate  online  corps'  within  it. 
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army,  ana  is  input  to  fCSCE'*  by  the  user.  (The  tern 
"forward  control  chase  line  of  a  coros"  is  also  -sed;  this 
is  an  internal  model  artifice  for  controlling  tht  movement 
of  subordinate  divisions.  >or  tn»  ourjose s  of  this 
experiment,  read  “forward  control  phase  line  of  a  cores"  to 
mean  "location  of  the  coros"  to  mean  "location  of  the  most 
forward  division  in  the  coros".)  The  army  objective  chase 
line  can  be  "forward"  of  the  location  of  the  corps,  “at"  the 
location  of  the  coros,  or  “to  the  rear"  of  the  location  of 
the  coros . 

5.  The  posture  of  the  corps  (i.e.,  attack,  defend, 
delay,  or  withdraw).  The  posture  is  the  mission  assignee  to 
the  coros  by  its  parent  army  HQ S . 

t  .  The  f r  i  e nd  l  y- 1 o-e ne my  force  ratio  faced  oy  the 
corps,  as  perceived  by  the  parent  army  HOE. 
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A .  G  c  NE  5 *1  . 


The  force  Evaluation  model  (fCRCEM)  is  a  computer 
simulation  developed  or  the  US  *rmr  Conceots  Analysis 
Agency.  It  treats  combat,  combat  support,  and  combat 
service  support  (CSS)  in  a  'heater  of  operations. 

Activities  are  represented  at  four  echelons:  theater,  army, 

corps,  and  division  (in  US  terminology).  The  primary  unit 
tor  combat  is  the  aivision.  The  representation  of  command 
and  control  <  f  2 )  is  f ul t y-a utoma t ed .  for  each  theater, 
army,  ana  corps  headquarters  (HQS),  decisions  are  made 
internally  by  f 0 RC t M  about,  or  that  directly  affect, 
immediate  S uoo rc i na f e S .  Thus,  for  example,  an  army  HQS 
assigns  a  priority  for  fSS  to  each  of  its  subordinate 
corps'.  for  each  Decision  for  a  hq$,  there  is  a  set  of 
rules  encoded  into  fORCEf*  that,  in  turn,  reference  a 
predetermined  set  of  parameters  from  the  "perception 
database"  (containing  perceived  information  about  the  HUS 
itself,  its  suoordi nates,  and  enemy  forces),  and  that  apply, 
as  veli,  input  threshold  parameters. 


The  purpose  of  this  experiment,  and  of  the  subsequent 
statistical  analysis  to  be  performed  on  the  results,  is.  to 
validate,  an  possibly  enhance,  tne  r e o r e s en t a t i on  of  one 
such  decision  oy  detemininr  — 

1.  .hether  the  parameters  currently  used  from  the 
perception  database  are  necessary  and  proper,  ana  if  so,  ho* 
tney  should  be  combined  in  making  the  decision. 

2.  whether  adcitional  information  is  relevant,  and 
should  be  added  to  the  list  of  parameters  used  in  the 
decision. 


The  experiment  itself  will  be  administered  on  the  VAx 
minicomputer.  After  the  experiment,  a  questionnaire  will  be 
provided  to  be  completed  in  handwritten  form;  it  will  also 
assist  in  achieving  the  above  goal. 


E •  S^EC 1 f  1  C  . 


The  topic  of  this  experiment  is  the  decision  on 
assignment  of  a  newly  arrived  field  artillery  battalion. 

Euch  a  unit  may  enter  the  theater  after  the  beginning  of  the 
simulation.  If  the  unit  is  not  preassigned  by  the  user  to 
an  existing  HQS,  then  logic  internal  to  fCRCE"  assigns  the 
unit  to  an  existing  corps  HQS. 


Ihe  mechanism  used  in  determining  the  corps  nQS  to  «  n  i  c  r 
the  newly  arrived  field  artillery  battalion  is  to  De 
assigned  involves  ranking  the  ootential  receiving  tores  '  by 
need,  ana  then  selecting  the  cores  with  the  greatest  nee-'. 
The  need  of  a  coros  is  soecified  by  a  numerical  criticality 
that  is  computed  based  on  the  perception  database  parameter' 
shewn  below.  These  are  the  parameters  to  be  varied  in  the 
e  xpe  r i ment • 

1.  whether  the  coros  is  online  or  reserve. 

2.  The  ratio  of  the  number  of  corps-level  field 
artillery  battalions  currently  assianed  to  the  corps  HQS,  tc 
the  number  of  divisions  in  'h»  corps.  for  examole,  a  ratio 
cf  C.25  means  that  there  is  one  ccros-level  fielo  artillery 
battalion  for  each  four  divisions. 

1.  Ihe  location  ot  the  parent  army's  objective  phase 
line  relative  to  the  location  of  'he  corps.  The  army 


1 
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objective  chase  tine  designates  the  desired  locations  to  be 
reached  lor  held)  oy  subordinate  online  corps  yithin  the 
army,  and  is  inout  to  fCACE'1  by  the  user.  (The  tern 
"tor»ard  control  phase  line  of  a  corps’*  is  also  used;  this 
is  an  internal  model  artifice  for  controlling  the  movement 
of  suBoruinate  divisions.  (or  the  purposes  of  this  ( 
e«perimenti  read  "forward  control  phase  line  of  a  corps  to 
mean  "location  of  the  corps"  to  mean  "location  of. the  most 
forward  division  in  the  coros".)  The  army  oojective  chase 
line  can  be  "forward"  of  the  location  of  the  corps,  “at”  the 
location  of  the  cores,  or  "to  the  rear"  cf  the  location  of 
the  cores  . 

A.  The  posture  of  the  corps  (i.e.,  attack,  defend, 
delay,  or  withdraw).  The  posture  is  the  mission  assignee  to 
the  coros  by  its  parent  army  bQS. 


CAA-SR-86-5 


CES1GNATE  P  0  S  TU  B  £  OF  ONLINE  CORPS 


A .  GENERAL. 


The  Force  Evaluation  "odel  <FO(.:E'*)  is  a  computer 
simulation  developed  Bv  the  u?  Army  Concepts  Analysis 
Agency.  It  treats  combat,  combat  supoort,  and  eomoat 
service  support  (CSS)  in  a  theater  of  operations. 

Activities  are  represented  at  tour  echelons:  theater,  army, 
corps,  and  division  (in  US  terminology).  The  primary  unit 
tor  combat  is  the  Division.  The  representation  o*  command 
and  control  (C2)  is  f u l l y -a u t om a t e d .  lor  each  theater, 
army,  ana  corps  headquarters  (HOS),  decisions  are  made 
internally  by  FORCE*  scout,  or  that  directly  affect, 
immediate  suboroinates.  Thus,  for  example,  an  army  HQS 
assigns  a  priority  for  CSS  to  each  of  its  subordinate 
corps'.  For  each  oecision  for  a  PQS,  there  is  a  set  of 
rules  encoded  into  FORCE*  that,  in  turn,  reference  a 
predetermined  set  of  parameters  from  the  "perception 
database"  (containing  perceived  information  about  the  h  3  S 
itself,  its  suoordinates ,  ana  enemy  forces),  and  that  apply, 
as  well,  input  threshold  parameters. 


The  purpose  of  this  experiment,  and  of  the  subsequent 
statistical  analysis  to  be  performed  on  the  results,  is  to 
validate,  an  possibly  enhance,  the  representation  of  one 
such  decision  oy  determining-- 

1.  .hether  the  parameters  currently  used  from  the 
perception  database  are  necessary  and  proper,  ana  if  so,  ho. 
they  should  be  comoined  in  making  the  decision. 

2.  .hether  additional  information  is  relevant,  ana 
should  be  added  to  the  list  of  parameters  used  in  the 
decision. 


The  experiment  itself  will  be  administered  on  the  VA» 
mini  computer .  After  the  experiment,  a  questionnaire  will  be 
provided  to  be  completed  in  handwritten  form;  it  will  also 
assist  in  achieving  the  above  goal. 


S  .  3  F  E  C  1  f  1  C  . 


The  topic  of  this  experiment  is  the  decision  by  an  army 
HQS  on  the  posture  of  a  subordinate  online  corps.  Py 
posture  is  meant  the  assigned  mission;  within  FORCE*, 
posture  has  one  of  four  values:  attack,  defend,  delay,  or 
•itharaw.  Conceptually,  the  oosture  of  an  online  corps 
designates  the  intensity  with  which  the  corps  is  to  attempt 
to  move  forward  toward  (or  hold  at)  the  army's  oojective 
phase  line.  The  latter  is  described  belcw. 


The  decision  on  the  posture  o  ♦  an  online  corps  is  based 
on  the  perception  database  parameters  shewn  below.  These 
.re  the  parameters  to  be  varied  in  the  experiment. 

1.  The  f  r  i  e  nrl  l  y- t  o- e  ne  my  force  ratio  faced  uy  the 
online  corps,  as  perceived  by  the  army  WQE. 

2.  The  location  of  the  army's  objective  phase  tine 
relative  to  the  location  of  the  corps;  i.e.,  the  army 
objective  phase  line  is  "forward"  of  the  corps,  "at  the 
location"  of  the  corps,  cr  "to  the  rear”  of  the  corps.  The 
armv  oojective  phase  line  designates  the  desired  locations 
to  be  reacheo  (or  held)  by  subordinate  online  corns'  within 

the  a  r  my  . 

3.  The  posture  of  the  army  mGS  (again,  attack,  cefeno, 
delay,  or  withoraw)  as  specified  hy  the  m  n  d  .  i.  „ser. 


CAA-SR-36-5 


SPEC1M  FalOAlTi  TO  CCRPS  f  0  R  C  ‘5 


GENERAL. 


The  force  Evaluation  *odel  IfCRCE'")  is  a  computer 
simulation  developed  by  the  US  Army  Conceots  Analysis 
Agency.  It  treats  combat,  comoat  suooort,  and  co*bat 
service  sucoort  (CSS)  in  a  th»ater  of  ooeraticns. 

Activities  are  represented  at  four  echelons:  theater,  arm y 
corps,  and  division  (in  US  terminology).  The  primary  unit 
for  combat  is  the  aivision.  The  re p r e s e n t a t  i  on  of  command 
and  control  ( C  2  )  is  fully-automated.  for  each  theater, 
army,  ana  corps  headquarters  (KGS),  decisions  are  made 
internally  by  fCRCE!*  about,  or  that  directly  affect, 
immeaiate  suborainates.  Thus,  for  example,  an  army  HGS 
assigns  a  priority  for  CSS  to  each  of  its  subordinate 
corps'.  for  each  decision  for  a  JQS,  there  is  a  set  of 
rules  encoded  into  fORCEM  that,  in  turn,  reference  a 
p r ed e t e rm i n e d  set  of  parameters  from  the  "perception 
catabase"  (containing  perceived  information  about  the  HQS 
itself,  its  subordinate s ,  ana  enemy  forces),  and  that  apply 
as  veil,  input  threshold  parameters. 


The  purpose  of  this  experiment,  and  of  the  Subsequent 
statistical  analysis  to  be  performed  on  the  results,  is  to 
validate,  an  possibly  enhance,  the  representation  of  one 
such  decision  by  de t e r m i n i n o-- 

1.  vhether  the  parameters  currently  used  from  the 
perception  database  are  necessary  ana  orooer,  ana  if  so,  ho. 
they  should  be  comoined  in  making  the  decision. 

2.  vhether  additional  information  is  relevant,  anc 
should  he  added  to  the  list  of  parameters  used  in  the 
decision. 


The  experiment  itself  vill  be  administered  on  the  VAx 
m ini  compute r  .  After  the  experiment,  a  questionnaire  will  be 
provided  to  be  completed  in  handwritten  form;  it  will  also 
assist  in  achieving  the  above  goal. 


£  .  SPE  C I M  (  . 


The  topic  of  this  experiment  is  the  decision  by  an  army 
hQS  on  tne  priority  of  a  subordinate  corps  for  close  air 
support  (CAE).  This  priority  is  a  numerical  value  that  is 
use  in  tne  fOR(EM  fire  support  module  in  the  distribution  of 
(AS  aircra*t  sorties  by  the  army  WQ$  to  subordinate  corps' 
.hen  requirements  for  <as  exceed  available  aircraft. 


The  decision  on  the  (*S  priority  cf  a  corps  is  based  on 
t'-e  gerceotion  database  parameters  shown  below.  These  are 
the  parameters  to  be  varied  in  the  experiment. 

1.  echelon  to  which  the  corps  is  assigned  (online  or 
reserve). 

2.  «hether  or  not  the  corps  is  engaged. 

i.  The  friendly-to-enemy  force  ratio  faced  py  the 
corns,  as  perceivea  by  the  army  HOS. 


The  experiment  uses  the  term  "criticality”  for  (AS 
support.  Read  “criticality"  'o  mean  "oriority". 


i  *a|  ffat  “al  * 
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4.  SEVERAL. 

The  lores  evaluation  model  (ICRCE"*)  is  a  computer 
simulation  develooed  by  the  US  »  rmy  Concepts  Analysis 
Agency.  It  treats  comoati  comoat  supoort,  and  co"tat 
service  support  (CSS)  in  a  theater  of  operations. 

Activities  a  re  represented  at  four  echelons:  theater,  army, 
corps,  and  division  (in  US  terminology).  The  primary  unit 
for  combat  is  the  division.  The  representation  of  command 
and  control  ( C  Z )  is  f u t  l  y -a u t om a t ed .  for  each  theater, 
army,  ana  corps  headquarters  (HOS),  decisions  are  made 
internally  by  FCRCEM  about,  or  that  directly  affect, 
immediate  suCordi nates .  Thus,  for  example,  an  army  hq$ 
assigns  a  priority  for  CSS  to  each  of  its  subordinate 
corps'.  Tor  each  decision  for  a  hq$,  there  is  a  set  of 
rules  encooed  into  TCRCS*  that,  in  turn,  reference  a 
predetermined  set  cf  parameters  from  the  "perception 
database"  (containing  perceived  information  about  the  was 
itself,  its  subordinates,  and  enemy  forces),  ana  that  apply, 
as  well,  input  threshold  parameters. 


The  purpose  of  this  experiment,  and  of  the  subsequent 
statistical  analysis  to  be  oerformed  on  the  results,  is  to 
validate,  an  possibly  enhance,  the  representation  of  one 
Such  decision  by  determining-- 

1.  whether  the  parameters  currently  used  frem  the 
perception  database  are  necessary  and  proper,  ana  if  so,  ho, 
they  should  be  combined  in  making  the  decision. 

2  .  whether  additional  information  is  relevant,  and 
should  be  added  to  the  list  of  parameters  usea  in  the 
dec  i  s  ion. 


The  experiment  itself  will  be  administered  on  the  V ax 
minicomputer.  After  the  experiment,  a  questionnaire  .ill  be 
provided  to  be  completed  in  handwritten  form;  it  will  also 
assist  in  achieving  the  above  goal. 


e .  SPECIFIC. 


available  resources. 

The  decision  on  the  CSS  priority  of  a  corps  is  based  on 
the  perception  database  parameters  shown  below.  These  ar« 
the  parameters  to  be  varied  in  the  experiment. 

1.  Echelon  to  which  the  corps  is  assigned  (online  or 
reserve). 

2.  whether  or  not  the  corps  is  engaged. 

2.  The  f r  i  e nd  l  v- 1 o- e ne my  force  ratio  faced  oy  the 
corps,  as  perceivea  by  the  army  hOS. 

The  experiment  uses  t  h  e  term  "criticality"  for  (4$ 
Support.  Read  "criticality"  fo  mean  "priority". 


a'ahv.v;; 
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A  .  G  E  NE  h  A  L  . 


The  force  Evaluation  Mod  e  l  (  l  hS ( E  “ )  is  a  computer 
simulation  developed  by  the  US  Army  Concepts  Analysis 
Aoency.  It  treats  comeat,  combat  support,  and  comcat 
service  support  (CSS)  in  a  theater  of  operations. 

Activities  are  represented  at  four  echelons:  theater,  army, 

corps,  and  division  (in  US  terminology).  The  primary  unit 
for  combat  is  the  division.  The  representation  of  command 
and  control  ((c)  is  f u l l y -a u t om a t e d  .  for  each  theater, 
army,  and  corps  heaoquarters  (HQS),  decisions  are  made 
internally  ty  (CSCE'1  aoout,  or  that  directly  affect, 
immediate  subordinates.  Thus,  for  example,  an  army  hos 
assigns  a  priority  for  CSS  to  each  of  its  subordinate 
corps'.  Tor  each  aecision  for  a  bQS,  there  is  a  set  of 
rules  encoded  into  f C s C E *  that,  in  turn,  reference  a 
predeterminer1  set  of  parameters  from  the  "perception 
database”  (containinc  perceived  information  about  the  HGS 
itself,  its  s uo o rd  i  na t e s  ,  ana  enemy  forces),  and  that  apply, 
as  veil,  input  threshold  parameters. 


The  purpose  of  this  experiment,  and  of  the  subsequent 
statistical  analysis  to  be  performed  on  the  results,  is  to 
validate,  an  possibly  enhance,  the  representation  of  one 
such  decision  by  determ  inino-- 

T.  .hether  the  parameters  currently  used  from  the 
perception  database  are  necessary  ana  prooer,  ana  i*  so,  how 
they  should  be  combined  in  making  the  decision. 

2.  .hether  additional  information  is  relevant,  ano 
should  be  added  to  the  list  of  parameters  used  in  the 
decision. 


The  experiment  itself  will  be  administered  on  the  V»< 
minicomputer.  After  the  esperiment,  a  questionnaire  will  be 
provided  to  be  completed  in  handwritten  form;  it  will  also 
assist  in  achieving  the  above  goal. 


£  .  $  r  E  (  1  f  1  (  . 


lhe  toc’c  of  this  experiment  is  the  decision  by  a  cores 
HQE  on  the  priority  of  a  subordinate  division  tor  close  ,ir 
support  CCA').  This  priority  is  a  numerical  value  t  *  a  t  is 
use  in  the  f C B C E M  *ire  support  module  in  the  distribution  o* 
C*s  aircraft  sorties  by  the  corps  to  subordinate  divisions 
.hen  reauirements  for  C  a'  exceed  available  lire  r,‘t  . 


The  aecision  on  the  (*$  priority  c  ♦  a  civisiun  is  cased 
cn  the  perception  database  parameters  shewn  below.  lk( se 
are  the  parameters  to  oe  varied  ir  the  experiment. 

1.  Echelon  to  »hicfc  the  division  is  assignee  (  i  .  e  .  , 
first  ecnelcn  -  committed  to  combat;  seccno  echelor  = 
available  for  combat  but  nor  committed;  or  third  e  c  *■  e  t  c  n  = 
in  repair  ano  refurbishment). 

i.  .hether  or  net  the  division  is  engaged. 

!.  The  friendlv-to-enemy  *  o  r  c  e  rins  faced  ;v  f  *■  e 
division,  as  perceived  by  t  *•  e  corps  h  0  S  . 


The  experiment  uses  the  r»rm  “ criticality"  ‘or  t  i' 
support.  »  e  a  a  "criricalitv"  ’o  mean  "ancri'i". 
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GPElIfl  PAIOOJTT  TC  DIVISION  I  0  fi  CSS 


A.  GENERAL. 


The  force  Evaluation  '4ode  l  (  f  CB  C  E  d  )  is  a  computer 
simulation  developed  by  the  US  Army  Concepts  Analysis 
Agency.  It  treats  combat,  combat  support,  and  combat 
service  support  (CSS)  in  a  theater  of  operations. 

Activities  are  represented  at  tour  echelons:  theater,  army, 

corps,  and  division  (in  US  f e rm i no l og y )  .  The  primary  unit 
tor  combat  is  the  division.  The  re p r e s e n t a t i on  of  command 
and  control  CC2)  is  f u l l y -a u t om a t e d .  For  each  theater, 
army,  and  cores  headquarters  (HOS),  decisions  are  maoe 
internally  by  fCfiCcM  about,  or  that  directly  affect, 
immediate  s ubo ro i na t e s .  Thus,  for  example,  an  army  HQS 
assigns  a  priority  for  CSS  to  each  of  its  subordinate 
corps'.  For  each  decision  for  a  HQS,  there  is  a  set  of 
rules  encoded  into  FCBCf*  that,  in  turn,  reference  a 
predetermined  set  of  parameters  from  the  "perception 
catabase"  (containing  perceived  information  about  the  HGS 
itself,  its  s uoo r d  i  n a t e s  ,  ana  enemy  forces),  and  that  apply, 
as  well,  input  threshold  parameters. 


The  purpose  of  this  experiment,  and  of  the  subsequent 
statistical  analysis  to  be  oerformed  on  the  results,  is  to 
validate,  an  possibly  enhance,  the  representation  of  one 
such  decision  oy  de t e r m i n i no -- 

1 .  whether  the  parameters  currently  used  frem  the 
perception  database  are  necessary  and  proper,  ana  if  so,  how 
they  should  be  compined  in  making  the  decision. 

2.  whether  additional  information  is  relevant,  and 
should  be  addea  to  the  list  of  parameters  used  in  the 
decision. 


The  experiment  itself  will  be  administered  on  the  va» 
minicomputer.  After  the  experiment,  a  questionnaire  will  be 
provided  to  b«  completed  in  handwritten  form;  it  will  also 
assist  in  achieving  the  above  goat. 


6 .  SPECIFIC. 


The  topic  of  this  experiment  is  the  decision  by  a  corps 
HQS  on  tne  priority  of  a  subordinate  division  tor  CSS 
support.  This  priority  is  a  numerical  value  that  is  useu  in 
the  FCRCE"  CSS  module  in  the  distribution  of  supplies  anu 
replacement  personnel  and  vehicles  when  demand  exceeds 
available  resources. 


The  decision  on  the  CSS  priority  of  a  division  is  based 
on  the  oercection  oataOase  oarameters  shown  below.  These 
are  the  parameters  to  be  varied  in  the  experiment. 

1.  Echelon  to  which  the  division  is  assigned  (i.e., 
first  echelon  =  committed  to  combat;  second  echelon  = 
available  for  combat  put  no’  committed;  or  third  echelon  = 
in  reoair  and  refurbishment). 

2.  whether  or  not  the  division  is  engaged. 

!.  1 he  f r i e nd l y - t o-e ne my  force  ratio  faced. cy  the 

division,  as  perceived  by  the  corps  HOS. 


The  experiment  uses  the  term  "criticality"  for  CAS 
Supcort.  Bead  "criticality"  to  mean  "priority". 
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APPENDIX  D 

POST-EXPERIMENT  QUESTIONNAIRE 


This  appendix  contains  a  copy  of  the  questionnaire  prepared  by 
Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI) 
tration  to  subjects  after  completion  of  the  experiments. 


the  US  Army 
for  adminis 
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BATTLE  MANAGEMENT  DECISION  [Circle  number! 


1.  Assignment  of  new  Corpi 

2.  Assignment  of  new  Division 

3.  Assignment  of  new  artillery  unit 

4.  Commitment  of  reserve  Corps 

5.  Selection  of  Corps  posture 

6.  Priority  of  Corps  for  Close  Air  Support 

7.  Priority  of  Corps  for  Combat  Service  Support 

8.  Priority  of  Division  for  Close  Air  Support 

9.  Priority  of  Division  for  Combat  Service  Support 
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DECISION  FACTORS 


DEGREE  OF  IMPORTANCE 
Low  Moderate 


A.  Number  of  Corps  in  reserve 

[0.11 

8.  Corps  engagement  status 
[No,  Yes] 

C.  Corps  force  ratio 

[1/3,1/1,3/11 

D.  Corps  location  and  posture 

[Behind/Withdraw .  In  front/ Attack] 

E.  Corps  status  and  number  of  Corps  behind 

[Reserve,  On-line/1  Res,  On-line/O  Res] 

F.  Echelon  to  which  Corps  is  assigned 

[Reserve,  On-line] 

G.  Ratio  of  current  artillery  to  current  Divisions 

[1/1,  1/41 

H.  Support  status  of  reserve  Corps 

(Desparate,  Poor,  Okay] 

I.  Number  of  combat  ready  Divisions  in  1st,  2nd  Ech 

[1,3] 

J.  Have  2nd  echelon  Divisions  been  committed? 

[No,  Yes] 

K.  Is  on-line  Corps  holding  up  advance  of  adj  Corps? 

[No,  Yesl 

L.  Location  of  the  Army  Objective  Phase  Line 

(Behind,  At.  In-front] 

M.  Current  posture  of  Corps  '  parent  Army 

(Delay.  Defend,  Attack] 

N.  Division  engagement  status 

[No.  Yesl 

O.  Division  combat  worth  force  ratio 

[1/3,  1/1,  3/1] 

P.  Echelon  to  which  Division  is  assigned 

[3rd,  2nd,  Istl 


a 

a 

a 

a 

a 

c> 

o 

o 

a 

o- 

c> 

o 

o 

o 

a 

a 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


.A 
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DECISION  FACTORS 

DEGREE  OF  REALISM 

[Check  one) 

Artifact  of  simulation  model 

Real-world  variable 

A. 

Number  of  Corps  in  reserve 

c - 

- 0 

B. 

Corps  engagement  status 

0 - 

— o 

C. 

Corps  force  ratio 

o - 

— o 

D. 

Corps  location  and  posture 

0 - 

— o 

E. 

Corps  status  and  number  of  Corps  behind 

0 - 

— o 

F. 

Echelon  to  which  Corps  is  assig  ned 

0 - 

- 0 

G. 

Ratio  of  current  artillery  to  current  Divisions 

0 - 

— o 

H. 

Support  status  of  reserve  Corps 

0 - 

— o 

1. 

Number  of  combat  ready  Divisions  in  1st,  2nd  Ech 

0 - 

- 0 

J. 

Have  2nd  echelon  Divisions  been  committed? 

0 - 

- 0 

K. 

Is  on-line  Corps  holding  up  advance  of  adj  Corps? 

0 - 

- 0 

L. 

Location  of  Army  Objective  Phase  Lina 

o - 

- O 

M. 

Current  posture  of  Corps'parant  Army 

o - 

- 0 

N. 

Division  engagement  status 

o - 

— o 

0. 

Division  combat  worth  force  ratio 

o - 

— o 

P. 

Echelon  to  which  Division  is  assigned 

o - 

- 0 

For  each  factor  considered  to  be  an  artifact  of  the  simulation  model,  briefly  describe  how  this  information  might 
be  estimated  from  reel-world  data  sources  available  to  the  commander: 


D-fi 
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DECISION  FACTORS  DEGREE  OF  UNCERTAINTY  [Cheek  one] 


Unknown 

Moderate 

Hard  Data 

Uncertainty 

A.  Number  of  Corps  in  reserve 

o - 

- o - 

- o 

B.  Corps  engagement  status 

0 - 

- 0 - 

- o 

C.  Corps  force  ratio 

o - 

- 0 - 

- o 

0.  Corps  location  and  posture 

0 - 

- o - 

- O 

E.  Corps  status  and  number  of  Corps  behind 

0 - 

- 0 - 

- o 

F.  Echelon  to  which  Corps  is  assigned 

0 - 

- 0 - 

- o 

G.  Ratio  of  current  artillery  to  current  Divisions 

0 - 

- O - 

- 0 

H.  Support  status  of  reserve  Corps 

0 - 

- o - 

- o 

1.  Number  of  combat  ready  Divisions  in  1st,  2nd  Ech 

0 - 

- 0 - 

- o 

J.  Have  2nd  echelon  Divisions  been  committed? 

0 - 

- 0 - 

- Q 

K.  Is  on-line  Corps  holding  up  advance  of  adj  Corps? 

o - 

- 0 - 

- 0 

L.  Location  of  Army  Objective  Phase  Line 

0 - 

- o - 

- 0 

M.  Current  posture  of  Corps'  parent  Army 

0 - 

- o - 

- o 

N.  Division  engagement  sta  tus 

o - 

- o - 

- O 

O.  Division  combat  worth  force  ratio 

0 - 

- o - 

- O 

P.  Echelon  to  which  Division  is  assigned 

0 - 

- O - 

- o 

Briefly  describe  how  you  would  take  into  account  areas  of  uncertainty  for  this  specific  battle  management 
decision.  For  example,  would  you  operate  in  a  more  conservative  manner,  would  you  make  a  best-guess 
estimate  of  the  factor,  would  you  attempt  to  obtain  more  information,  etc,  etc. 
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APPENDIX  E 

WRITTEN  RESPONSES  TO  QUESTIONNAIRES 
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This  appendix  contains  a  compilation  of  the  written  responses  of  subjects 
obtained  from  the  questionnaire  of  Appendix  D.  The  responses  are  catego¬ 
rized  by  question  on  the  questionnaire.  Within  the  responses  for  one  cate¬ 
gory,  the  remarks  by  an  individual  subject  are  grouped  together.  The  number¬ 
ing  of  subjects  for  one  category  does  not  necessarily  match  the  numbering 
for  any  other  category;  hence  correlation  of  responses  across  questions  is 
not  possible  here.  The  intent  is  to  record  responses  and  to  give  the  reader 
the  flavor  of  the  types  and  numbers  of  responses  by  an  individual  subject. 


E-l 


CAA-SR-86-5 


ADDITIONAL  DECISION  FACTORS 


Participant  #1. 

a.  No.  of  casualties. 

b.  How  goes  the  battle?  Are  we  winning?  Losing?  Who  has  the  forward 
momentum?  We  or  they? 

c.  What  is  the  status  of  other  corps?  Where  are  their  weaknesses?  On 
the  flanks?  To  the  center?  Is  there  a  breakthrough  by  the  enemy?  Where? 
What  about  battle  terrain?  Easily  defended? 

d.  Consider  weather!  Where  are  the  friendly' (respectively,  enemy) 
tanks?  In  the  plain  or  in  the  hills? 

e.  Who  commands  enemy  echelons  above  corps?  How  does  he  work?  How 
good  is  his  intelligence?  How  long  has  he  been  engaged?  What  are  his 
losses? 

Participant  #2. 

a.  Availability  of  close  air  support  (few  sorties,  some  sorties,  many 
sorties) . 

b.  Availability  of  naval  gunfire.  Yes,  No? 

Participant  #3. 

a.  Logistic  capability  to  sustain  the  new  battalion. 

b.  Current  FA  battalion  status  within  division. 

c.  Future  objectives. 

d.  Type  enemy  force  (armored/mechanized/infantry) . 

Participant  #4. 

a.  Amount  of  surveillance,  reconnaissance  systems  up. 

b.  Success  of  national  level  intelligence  support. 

Participant  #5. 

a.  Type  divisions'. 

b.  Degree  of  mobi 1 i ty. 
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a.  Combat  power. 

b.  Terrain. 


c.  Mobility. 

Participant  #7. 

a.  Adjacent  unit  lines. 

b.  Percent  of  combat  effectiveness. 

c.  Terrain  and  mobility. 

d.  Status  of  supply. 

Participant  # 8. 

a.  Class  V. 

b.  Class  III. 

c.  Air  situation. 

Participant  #9. 

a.  Mission  of  corps. 

b.  Degree  of  fire  support  in  addition  to  close  air  support  (CAS). 
Participant  #10. 

a.  Current  and  anticipated  enemy  threat  (next  24  hrs). 

b.  Combat  readiness/capabi 1 ity  of  the  various  corps. 

c.  Overall  ammo,  POL,  and  logistics  status  of  the  corps. 

d.  Morale,  espirit  de  corps  and  fighting  discipline  of  major  subordinate 
units. 

e.  For  CAS  -  the  relative  exigencies  for  other  corps  based  on  the  threat 
to  that/those  corps. 

f.  For  combat  service  support  (CSS):  relative  army  stockage/supply 
capabilities  out  of  which  to  supply  given  corps. 
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a.  Who  initiated  engagement. 

Participant  #12. 

a.  Combat  status  of  other  units. 

b.  Force  ratio  status  of  other  units. 

c.  Combat  service  support/combat  support  (CSS/CS)  status  of  other  units. 

d.  Artillery  battalion  to  division  ratio. 

e.  Status  of  enemy  (attacking  or  defending). 

Participant  #13. 

a.  Corps  strength  {%  effectiveness,  morale,  etc). 

Participant  #14. 

a.  Status  of  supply. 

b.  Mission. 

Participant  #15. 

a.  Who/which  corps  is  "hurting"  the  worst? 

b.  What  is  the  corps  mission/objective? 

Participant  #16. 

a.  Status  of  flanking  units. 

b.  Time  in  current  battle. 

c.  Reserves. 

d.  Time  enemy  forces  in  current  battle  (fresh  troop  or  tired  troops). 


e.  Line  of  communication. 
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Participant  #17. 

a.  Mission. 

b.  Combat  support  (CS). 

c.  Combat  service  support  (CSS). 

d.  Scenario. 

e.  Log  base. 

Participant  #18. 

a.  Day/night. 

Participant  #19. 

a.  Strength. 

b.  Morale/fitness. 

c.  Capabil ity/equipment  status. 

Participant  #20. 

a.  Status  of  units  on  flanks. 

b.  What  is  the  enemy  doing?  (attacking,  defending,  etc.) 

c.  What  echelon  of  enemy  is  engaged? 

Participant  #21. 

a.  Enemy  air  status. 

b.  Enemy  follow-on  echelon  status. 

c.  Terrain. 

d.  Type  divisions  in  corps. 

e.  Training  status  of  division  of  corps. 

f.  Timing  -  time  in  relation  to  space. 
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Participant  #22. 

a.  Relationship  of  flank  friendly  units  (corps/division);  i.e.,  loca¬ 
tion  relative  to  my  position. 

b.  Posture  of  flanking  units. 

c.  Ammo  and  personnel  status. 

Participant  #23. 

a.  Time  of  reaction  to  need;  e.g.,  reserve  corps. 

Participant  #24. 

a.  Force  ratios  of  adjacent  corps  (online). 

Participant  #25. 

a.  Weather. 

b.  Aviation. 

Participant  #26. 

a.  Current  level  of  combat  service  support  (CSS)  for  corps. 

b.  Corps  current  mission. 

Participant  #27. 

a.  Doctrine. 

Participant  #28. 

a.  Type  of  terrain  occupied  (urban,  forested,  mountainous,  flat,  desert, 
etc. )? 

b.  Combat  service  support  status  (ammunition,  fuel,  combat  (CBT)  equip¬ 
ment  systems  status). 

Participant  # 29. 

a.  Logistic  posture. 

b.  Terrain. 

c.  Objective  (campaign). 

d.  Weather. 

e.  Combat  support. 
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Participant  #30. 

a.  Capability  to  counterattack  when  defending. 

b.  Capability  to  overcome  defenders  counterattack  when  attacking. 

c.  Army's  longer  range  operational  plan. 

d.  Supply  status  of  other  corps. 

e.  Availability  and  timeliness  of  other  army  reserve  assets. 

Participant  #31. 

a.  Overall  status  of  army  combat  support  good/close  air  support 
adequate. 

Participant  #32. 

a.  For  combat  service  support  (CSS),  what  is  current  fighting  capability 
of  division  (100%,  ?0%,  75%,  50%)? 

Participant  #33. 

a.  Morale. 

b.  Weather. 

c.  Nuclear/chemical  threat. 

d.  Terrain. 

Participant  #34. 

a.  Mission. 

b.  Commander's  interest. 

c.  Situation  of  adjacent  units. 

Participant  #35. 


a.  Length  of  time  online  or  reserve. 

b.  Strength. 


CAA-SR-86-5 


Participant  #36. 

a.  Location,  destination,  and  ETA  for  enemy’s  second  echelon  armies  and 
corps. 

b.  Support  status  of  online  corps. 

c.  Control  of  the  air. 

Participant  #37. 

a.  Time  in  offensive/defensive. 

b.  Time  in  location. 

Participant  #38. 

a.  Intelligence. 

b.  Communications. 

c.  Weather. 

Participant  #39. 

a.  Length  of  engagement. 

b.  Weather. 

c.  Support  status. 

d.  Frontages. 

Participant  #40. 

a.  Status  of  adjacent  corps. 

b.  Weather/terrain. 

c.  Type  of  corps/division.  For  example,  a  light  division  in  NATO  does 
not  attack. 

Participant  #41. 

a.  Terrain. 

b.  Type  Blue  units. 

c.  Enemy  intentions. 

d.  Supply  status  (Blue  ammo,  POL). 
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Participant  #42. 

a.  Readiness  posture  of  division/corps. 

b.  Type  corps/mechinized  or  light. 

c.  METT-T. 

Participant  #43. 

a.  Anticipated  success  of  forces  currently  engaged. 

b.  Force  structure  for  follow-on  missions  next  3-5  days. 

c.  Capability  of  corps  to  logistically  sustain  additional  forces. 
Participant  #44. 

a.  What  are  we  supposed  to  be  doing  as  a  corps  (regardless  of  status)? 

b.  Momentum.  Are  we  presently  advancing?  Going  back?  Winning? 
Losing? 

c.  Status  of  logistics  and  supplies. 

d.  How  far  can  I  see  (intelligence)? 

e.  Communication  status. 

f.  Weapon  strength. 

g.  Personnel  strength. 

h.  Morale. 

Participant  #45. 

a.  Weather. 

b.  Combat  service  support  (CSS). 

c.  Morale. 
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Participant  #46. 

a.  Status  of  corps  on  left  and  right  (engaged/not  engaged). 

b.  The  addition  of  adjacent  corps  is  vital  because  an  aggressive 
commander  of  a  corps  may  request  to  attack  when  the  parent  army  is 
defending.  For  example,  if  the  corps  on  the  left  is  engaged,  but  the  sub¬ 
ject  corps  is  not,  perhaps  he  could  attack  into  the  flank  of  the  enemy. 

Participant  #47. 

a.  Days  of  sustained  combat. 

b.  Battlefield  air  superiority. 

Participant  #48. 

a.  Location  of  army  objective  line  most  important. 

b.  Combat  effectiveness  of  corps/division  is  important. 

Participant  #49. 

a.  Ability  to  support  logistically. 

Participant  #50. 

a.  Log  status/readiness  of  corps/division. 

Participant  #51. 

a.  Status  of  adjacent  units. 

b.  Duration  of  engagements  at  point  of  decision. 

c.  Status  of  air  support.  »*' 

d.  Status  of  artillery  support. 

e.  Status  of  logistical  support. 

f.  Status  of  combat  support  units. 


i 
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DEGREE  OF  REALISM 


Participant  #1. 

a.  In  today's  world,  I  cannot  imagine  the  US  Army  engaged  in  a  war, 
having  a  corps  in  reserve— maybe  two  di vi sions— but  not  a  corps. 

b.  Re  #L — As  an  Army  commander,  I  do  not  give  a  damn  about  a  line.  In 
combat  I  want  to  attack,  to  take  away  the  initiative  of  an  enemy;  so  I 
will  attack  it  and  change  the  "phase  line". 


Participant  #2. 

d.  An  entire  corps  in  reserve  would  not  normally  be  engaged— portion  of 
the  corps  might  be  engaged  with  light  forces. 

e.  Normally,  not  more  than  1  corps  (at  most)  would  be  in  reserve. 

l.  Not  sure  what  this  means— if  it  is  the  Army's  objective  for  the  opera 
tion  than  it  is  a  real  world  variable. 

m.  Normally  the  entire  Army  would  have  one  posture— some  portions  would 
be  attacking,  another  defending,  etc. 

Participant  #3. 

Some  ratios  from  battle  reports  during  historical  engagements  should  be 
used. 

Participant  #4. 

Your  echelonment  terminology  is  vague  for  US  doctrine,  and  seems  unusually 
"Sovietized" . 

k.  This  could  happen,  and  is  likely  to  be  reported  or  become  evident  in 
lack  of  reporting  on  having  hit  certain  checkpoints.  It  can  be  partially 
solved  by  "priority  of  route"  orders  or  instructions  to  the  obstructing 
corps,  to  get  the  hell  off  the  roads  and  out  of  the  way. 

Participant  #5. 

l.  I  am  not  certain  what  corps  in  reserve  has  to  do  with  assignment  of 
division?— maybe  it  should  read  divisions  in  reserve? 

2.  Corps  in  reserve  usually  not  engaged. 

3.  Term  objective  phase  line  does  not  have  meaning. 
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Participant  #6. 

e.  Operations  order  to  corps  presumably  states  posture  of  parent  army. 
Not  sure  corps  commander  need  to  know  number  of  corps  behind.  If  army  has 
given  mission  and  resources  to  accomplish,  he  goes  to  it. 

n.  Op  ord  ought  to  tell. 

Participant  #7. 

a,  e,  f,  h.  It  is  my  belief  that  having  corps  in  reserve  is  a  figment 
of  the  imagination. 

Participant  #8. 

f.  Echelonment  is  foreign  to  US  vocabulary— it  is  a  threat  term. 

i.  See  above. 

j.  Reserve  division  committed. 

Participant  #9. 

Does  the  US  Army  now  use  the  term  echelon? 

Participant  #10. 

c.  Historical  studies  plus  several  computer  simulations  with  different 
players  each  time. 

i.  Factor  of  model  play  as  controlled  by  c. 

k.  See  c. 

m.  Factor  of  game  play;  see  c. 

n.  Factor  of  game  play;  see  c. 

o.  Factor  of  model  parameters,  requires  careful  discussion  and  evalua¬ 
tion  of  historical  results. 

Participant  #11. 

f.  Mission  and  location. 

o.  BOA's  and  unit  status  report;  however,  capabi 1 i ty  is  the  key 
assessment— i .e. ,  combat  forces  and  casualties  +  CSS  status,  LOC  condition, 
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Participant  #12. 

k.  Actual  cause  of  delay  for  an  adjacent  corps  is  not  as  critical  as 
the  delay  itself. 

Participant  #13. 

a.  Do  not  expect  the  war  to  last  long  enough  to  have  the  luxury  of  a 
corps  in  reserve? 

e.  Same  as  a. 

f.  Same  as  a. 

Participant  #14. 

m.  Parent  army's  subordinate  corps  may  be  conducting  completely  differ¬ 
ent  operations  (ATK,  DEF,  etc.)  at  same  time. 

Participant  #15. 

A  corps  would  not  be  in  a  2d  or  3d  echelon.  It  would  be  committed  or  not 
committed  to  a  combat  mission. 

Participant  #16. 

g.  You  can  not  have  too  much  artillery.  If  it  is  here,  use  it! 
Participant  #17. 

Some  would  be  available — friendly  hopefully.  Overall  strategy,  status  of 
adjacent  units,  etc.,  should  be  known  at  minimum. 

Participant  #18. 

Provide  army  commander's  concept;  e.g.,  the  campaign  plan  is  to  attack  when 
army  gains  superiority  in  sector,  or  the  campaign  plan  is  to  defend  along 
line  indefinitely,  etc. 

Participant  #19. 

Are  you  asking  about  US  or  Russian  units?  Echelon--Reserve? 

g.  Real  world  data  is  available. 

Participant  #20. 

Do  not  understand  question. 
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Participant  #21. 

Use  available  intelligence  to  determine  potential  for  combat  of  enemy 
forces. 

Participant  #22. 

a.  Available  individual  replacements;  arrival  of  POMCUS  units. 

e.  Same  as  above. 

f.  Mission  statement. 

g.  Currently  fixed. 

j.  EEI--tough  one  to  know, 
m.  Mission  statement, 
p.  Mission  statement. 

Participant  #23. 

Difficult  to  develop  based  on  understanding  of  capabilities  and  organiza¬ 
tion  of  threat.  Not  always  a  simple  1:3  or  3:1  ratio  in  effectiveness. 

Participant  #24. 

As  you  can  probably  surmise,  I  do  not  understand  this  question.  In  any 
case,  terminology  is  the  biggest  "artifact"  problem. 

"Echelon" — ?  (on-line  or  reserve  (Only?)). 

"Posture"  should  be  "mission1  (your  description  is  its  current  activity, 
which  may  or  may  not  be  its  mission). 

Support  status  =?  (strength?) 

Participant  #25. 

a.  Likelihood  of  US  corps  in  reserve  is  remote. 

b.  All  corps  would  be  engaged  soon. 

Participant  # 26. 

Information  may  be  available  to  army  commander  which  is  not  immediately 
available  to  corps  or  division  commander.  Information  deemed  necessary  to 
the  lower  echelon  commanders  will  normally  be  surmised  thru  the  respective 
staff  estimates  and  the  forecasts  from  higher  HQ  as  available. 
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Participant  #27. 

Corps  force  ratio--talk  to  corps  commander  and  find  out  what  he  is  facing 
(from  his  intell igence/combat  reports). 

Participant  #28. 

One  cannot  help  but  be  driven  mentally  to  the  Europe  scenario--this  inten¬ 
sity  of  combat  at  this  level  is  just  not  realistic  at  any  lesser  level  of 
intensity.  And  in  Europe,  its  all  up  front  to  defend,  with  even  those 
forces  not  sufficient  in  all  areas;  i.e.,  it's  a  one-echelon  defense.  The 
only  reserves  are  on  the  TPDFL. 

Participant  #29. 

In  a  heavy,  medium-  to  high-intensity  fight  in  Europe,  everything  with  be 
committed,  at  least  initially.  We'll  be  lucky  to  have  one  reserve  division 
per  army  (e.g.,  CENTAG)--reserve  corps  will  not  be  available  for  some  time, 
if  ever. 

Participant  #30. 

Experienced  senior  commander  judgment — areas  probably  cannot  be  quantified 
or  extrapolated  except  for  academic  purposes. 

Participant  #31. 

Term  echelon  has  no  meaning. 

Participant  #32. 

Reports,  forward  observation,  aerial  observation  or  electronics  detection. 
Participant  #33. 

Concept  of  operations. 

Participant  #34. 


i.  Status  reports. 


CAA-SR-86-5 

DEGREE  OF  UNCERTAINTY 


Participant  #1. 

Try  to  obtain  more  info  but  don't  spend  too  much  time  doing  it. 

Participant  #2. 

Situationally  extrapolate  data. 

Participant  #3. 

Operate  in  conservative  manner  until  as  much  information  as  possible  was 
acquired. 

Participant  #4. 

Best-guess  estimate,  information  followup;  be  prepared  to  change  earlier 
decisions. 

Participant  #5. 

First  I  would  seek  confirmation  of  information,  best-guess  at  decision  point 
Where  I  wasn't  creating  the  battle's  "focal"  point,  I  would  have  to  be  abso¬ 
lutely  sure  that  I  needed  to  commit  reserve  division(s).  This  commitment 
would  bring  out  my  "conservati ve  side"--desperate  straits  before  I  would 
release  it/them. 

Participant  #6. 

Plan  worst  case  in  resolving  uncertainties.  Take  aggressive  action  and  do 
not  wait  for  the  situation  to  improve  on  its  own. 

Participant  #7. 

In  general,  most  data  will  be  uncertain  (Clausewitz  "fog"  of  war).  Always 
attempting  to  get  more  information.  Some  uncertainties  (nuclear  weapons 
use)  will  cause  more  conservatism;  some  will  allow  boldness;  and  best-gues¬ 
ses  will  be  constant.  If  there  were  a  formula  for  this,  war  would  indeed 
be  a  science  and  not  an  art. 

Participant  #8. 


b.  Corps  Engagement  Status--questions. . .  (1)  How  heavily  engaged--Armor? 
Infantry?  Irregulars?  (2)  Best-guess  if  can't  know  with  certainty. 

1.  Location  of  Army  Objective  Phase  Line--What  is  purpose  of  phase  line? 
-limit  advance?--! imit  withdrawal? 
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Participant  #9. 

c.  Would  best-guess. 

k.  Would  seek  more  information. 

o.  Would  best-guess. 

Participant  #10. 

1  would  make  a  best-guess  estimate  of  the  factor. 

Participant  #11. 

My  battle  management  decisions  would  be  affected  by  all  uncertainties.  I 
would  insist  on  obtaining  best  possible,  updated  information  and  status 
estimates;  and,  given  the  overall  mission,  be  prepared  to  take  the  necessary 
risks  at  the  right  time  and  place. 

Participant  #12. 

Force  ratios  must  be  estimated  based  on  several  factors  to  include  battle 
reports,  losses  and  templating. 

Status  of  other  friendly  units  and  relationships  must  be  judged  and  measured 
against  "what  if"  situations,  and  not  merely  taken  on  face  value  of  situa¬ 
tion  reports. 

Participant  #13. 

Until  I  obtain  more  information  and  intelligence,  I  would  act  cautiously-- 
(in  a  conservative  manner). 

Participant  #14. 

j.  I  am  assuming  enemy  2d  echelon--best-guess. 

Participant  #15. 

Best-guess  on  basis  of  intelligence  available. 

Participant  #16. 

Don't  understand. 

Participant  #17. 

Force  ratios  will  have  a  degree  of  uncertainty  in  any  event.  Include  best 
estimates  and  proceed. 


All  the  above.  Information  is  power  and  should  prove  most  valuable. 

Specific  information  at  proper  time  could  turn  the  battle. 

Participant  #19. 

Sorry,  I  do  not  understand  the  question! 

Participant  #20. 

I  would  ask  for  more  information. 

Participant  #21. 

e.  Unrealistic  in  our  world  to  have  corps  behind. 

Participant  #22. 

h.  Conservative  manner, 
c.,  o.  Intel  1  best-guess, 
k.  More  information. 

Participant  #23. 

What  is  "combat  ready"? 

Participant  #24. 

o.  Evaluate  past  performance.  Play  division  conservatively  until  results 
come  in. 

c.  Constant  update  of  data  to  ensure  perceived  force  ratio  nolds. 
e.  Constant  update  of  data,  but  play  corps  normally, 
h.  As  e. 
n.  As  e. 


Participant  #25. 

Conservative  manner  making  best-guess  estimate. 
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Participant  #26. 

Always  attempt  to  keep  up-to-date  on  information;  prime  the  staff  for  fur¬ 
ther  information.  Be  prepared  to  accept  considerable  uncertainty,  but  exer¬ 
cise  creative  visualization  of  the  overall  battlefield  to  anticipate  likely 
(and  unlikely)  developments;  exercise  best-guess  estimate  at  critical  junc¬ 
tures  where  something  must  be  decided. 

Participant  #27. 

Information  on  the  above  should  be  obtained  rather  than  best-guessing. 
Participant  #28. 

Probably  make  a  best-guess;  however,  would  probably  cause  me  to  act  more 
conservatively. 

Participar  t  #29. 

l.  As  an  army  commander,  the  objective  phase  line  is  not  all  my  doing, 
but  involves  a  higher  HQ  and  adjacent  armies.  I  need  data  on  these  elements 
to  make  decisions  w/  more  certainty. 

m.  Without  an  overall  posture  of  my  army,  I  cannot  make  decisions  about 
my  corps. 

Participant  #30. 

Information  overload  is  part  of  the  fog.  I  would  go  with  best-guess  estimate 
after  culling  critical  data. 

Participant  #31. 

Both  force  ratios  would  be  based  on  a  best-guess  estimate. 

Participant  #32. 

Best  guess.  Accept  risk  and  execute  decisively. 

Participant  #33. 

For  programs  1,  5,  7,  there  is  definite  need  for  information  concerning  the 
adjacent  corps  (i.e.,  force  ratio,  status,  engagement,  location  regarding 
army  (parent)  objective  phase  line). 

Participant  #34. 


First  attempt  to  gain  additional  information--then  make  oest-guess  estimate. 


Would  attempt  to  gain  more  information  within  the  bounds  of  timeliness  and 
mission.  At  point  of  decision,  I  would  go  with  what  I  had. 

Participant  #36. 

k.  Battlefield  is  fluid. 

Participant  #37. 

Decisions  are  situational.  If  time  permitted  I  would  attempt  to 
eliminate/reduce  any  existing  uncertainties.  If  the  situation  does  not 
permit  such  luxury,  the  best-guess  estimate  would  have  to  suffice. 

Participant  #38. 

Estimating  current  engagement  status,  combat  worth  force  ratio  and  commit¬ 
ment  of  divisions  would  be  decided  on  a  combination  of  previous  unit  actions, 
currency  of  latest  reported  status  and  commanders  estimate  of  the  division 
commander's  ability  to  fight  his  division.  All  would  determine  the  degree 
of  uncertainty  that  is  acceptable. 

Participant  #39. 

For  areas  of  uncertainty  I  woulb  use  real  world  experience  and  a  best  guess. 
Participant  #40. 

Generally,  I  tend  to  be  more  conservative,  recognizing  that  even  engagement 
data  (for  example)  may  be  out  of  date  and  the  enemy  may  have  shifted  forces 
into  or  out  of  my  area  of  operations. 


Participant  #41. 
Make  a  best  guess. 
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SCENARIO  DEPENDENCE 


Participant  #1. 

1.  I  assumed  that  I  would  coordinate  movements  with  higher  HQ  and  my  own 
corps  and  did  not  give  a  damn  about  1 ines! 

Participant  #2. 

Friendly  status  would  be  situational  dependent. 

Participant  #3. 

Role  of  the  reserve  corps  would  be  different  in  different  theaters.  For 
example,  in  Europe  in  an  all  out  Warsaw  Pact  offensive,  it  would  certainly 
have  to  be  committed,  while  in  SWA  you  probably  would  not  have  a  full 
reserve  corps  to  commit;  all  limited  forces  would  be  online. 

Participant  #4. 

Is  this  your  version  of  the  term  "scenario”?  If  so,  it  needs  to  be  a  geo¬ 
graphic  variable  and  set  up  that  way.  In  a  scenario-specific  situation, 
the  geography/ location  would  affect  decisions. 

Participant  #5. 

d.  Depends  on  terrain  and  potential  enemy  forces  in  area.  Example: 
Korea  terrain  would  slow  down  enemy  advance  while  northern  Europe  plains 
would  allow  for  rapid  enemy  movement. 

Participant  #6. 

Scenarios  will  make  major  different  in  number,  size,  and  level  of  units 
assigned,  as  well  as  support  available  from  other  services. 

Participant  # 7 . 

The  role/importance  would  change  based  on  the  threat  being  faced/engaged. 
The  order  of  battle  and  threat  doctrine  would  dictate  importance.  My 
answers  in  the  experiments  were  based  on  a  European  scenario. 

Participant  #8. 

I  believe  that  all  of  the  above  are  scenario  dependent,  and  that  the  rela¬ 
tive  importance  is  a  function  of  the  theater  mission  and  the  specific 
characteri sties  of  that  theater. 

Participant  #9. 


Not  sure  what  you  are  asking  for? 
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Participant  #10. 

SW  Asia--roles  of  b,  c,  d,  change  rapidly  in  wider  spaced  swirling  battles. 
N,0  are  off  and  on  in  hours.  Europe  and  Korea  are  much  more  fixed  fights 
with  terrain  in  the  form  of  rivers  defining  battle  lines. 

Participant  #11.' 

Clearly,  the  factors  would  change  depending  the  scenario.  Plains  of  northern 
Europe  or  the  mountains  of  Korea,  or  the  deserts  of  SWA.  Additional  intel¬ 
ligence  of  enemy  position.  Esprit  de  corps,  combat  losses,  and  other  pieces 
of  the  scenario  must  be  considered.  Also,  local  militia  support  (favorable 
or  unfavorable)  must  be  explored.  The  changes  in  this  scenario  have  direct 
bearings  on  the  "values"  given  to  the  decision  factors. 

Participant  #12. 

A  scenario-specific  situation  would  most  likely  change  any  of  these  factors. 
In  Europe,  for  example,  the  status  of  committed  forces  and  reinforcements 
in  high-intensity  combat  would  be  very  different  than  that  in  a  low-  to 
mid-intensity  environment  in  SWA. 

Participant  #13. 

The  role  of  these  specific  factors  will  certainly  be  changed  in  the  European 
scenario  by  mission,  enemy,  terrain,  time  criticality,  and  morale  and  status 
of  troops.  Terrain  is  a  critical  decision  factor  which  will  change  as  a 
function  of  different  environmental  factors. 

Participant  #14. 

The  heavier  threat  in  Europe  makes  ratios  and  echelons  more  important. 

Must  keep  second  operational  echelon  in  mind,  plus  follow-on  forces  behind 

it. 

Participant  #15. 

g.  Echelon  to  which  corps  assigned.  Reserve  vs  online--the  probability 
of  being  engaged  by  heavy  forces  is  greater  Europe  for  reserve  forces.  SE 
Asia  also  has  good  possibility  of  reserve  corps  being  engaged  by  heavy 
forces. 


b.  Same  answers  as  above. 
Participant  #16. 

More  critical  is  METT-T. 
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Participant  #17. 

I  cannot  see  what  this  is  leading  to! 

Participant  #18. 

Unable  to  answer. 

Participant  #19. 

Terrain,  weather  (climate),  troop  training  (friendly  or  enemy)  will  all 
impact  on  each  factor  and  its  importance. 

Participant  #20. 

Do  not  see  this  as  area/terrain  dependent.  But--what  is  my  mission,  strate¬ 
gic  objective,  etc.? 

Participant  #21. 

A  corps  can  defend  more  easily  in  mountainous  Korea  than  attach.  Fewer 
forces  are  needed,  too.  A  larger  reserve  may  be  wanted  in  SWA  than  Korea. 
Force  ratio  in  Europe  is  more  critical. 

Participant  #22. 

Intensity  of  combat,  enemy  forces,  and  friendly  intent. 

Participant  #23. 

Depth  of  the  battlefield  in  terms  of  terrain  would  influence  how  much  risk 
you  would  take  in  allowing  a  corps  in  a  favorable  attack  posture  to  go 
beyond  an  army  objective  line  in  order  to  take  maximum  advantage  of  maneuver 
against  the  rear  echelons  of  an  enemy  force. 

Participant  #24. 

Force  ratio  status  would  be  affected  by  air  status  especially  in  Europe 
where  bad  weather  may  reduce  effectiveness  of  Red  air.  Partially  true  also 
in  Korea;  not  at  all  true  in  SWA. 

Participant  #25. 

Very  1  ittle. 

Participant  #26. 


d.  1.  A  Korean  scenario  would  Jepend  upon  tactical  disposition  of  forces 
as  determined  by  terrain. 
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Participant  #27. 

Terrain  will  dictate  different  allocations  of  forces  in  these  regions.  You 
want  as  many  forces  online  and  in  contact  as  terrain  and  enemy  status 
permits/dictates. 

Participant  #28. 

Factor  of  METT-J. 

Participant  #29. 

Factors  of  METT-T  must  be  applied  at  all  levels  of  command.  The  employment 
of  resources  depends  upon  the  commanders  analysis  of  these  factors.  Parameters 
are  established  to  trigger  a  need  for  a  decision  but  a  look  at  all  factors 
must  be  made  before  the  decision  is  made. 

Participant  #30. 

d.  Terrain  drives  battle  decisions  so  much  that  a  map  is  essential  for 
location/posture  decisions. 

1.  Distance,  terrain,  plus  time  marked  here.  Need  this  data. 
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PROTOTYPICAL  SITUATION 


Participant  fl. 

Central  European  scenario  with  more  than  the  on-line  corps  considered,  addi¬ 
tional  POMCUS  divisions  and  NATO  divisions  are  forward. 

Participant  #2. 

Need  to  put  into  a  scenario  to  make  the  responses  more  meaningful. 

Participant  #3. 

While  the  "experiment"  expands  beyond  mindless  computations  of  force  ratio 
in  the  decision  process,  I  am  fearful  that  you  are  trying  to  discover  a 
cookbook  for  corps  commanders--and  hopeful  that  they  will  reject  such 
nonsense.  I  cannot  emphasize  enough  how  important  the  mi ssion  is  to  deci¬ 
sion  process.  Windows  of  opportunity  for  commanders,  based  upon  "what's 
happening"  or  might  in  48,  72,  96,  hours  can't  be  slammed  shut  by  mathema¬ 
tical  formula.  This  experiment  did  not  (nor  can  others)  model  the  human 
dimension  of  these  decisions. 

Participant  #4. 

Yes--from  my  limited  experience  in  tactical  maneuvers,  NTC  scenarios  came 
to  mind.  I  had  to  expand  from  battalion-task  force  scope  to  corp/army 
level . 

Participant  #5. 

Yes--In  planning  combat  support  and  combat  service  support  systems  to  sup¬ 
port  the  fighters,  prototype  situations  (defend,  attack,  delay,  etc.)  and 
distances  and  time  come  to  mind. 

The  MAP  is  key,  but  some  of  these  prototypes  elements  such  as  defend,  attack, 
distance,  engaged,  etc.  make  the  preliminary  decisions  easier. 

Participant  #6. 

No  prototypical  situation  comes  to  mind. 

The  conditions  considered  typify  the  thought  process,  although  not  normally 
in  the  specific  manner  described. 

Participant  47. 

Yes--The  execution  of  an  armored  division's  GDP  in  VII  Corps  in  Europe. 
Participant  43. 

The  European  theater  comes  immediately  to  mind. 
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No!  Need  refinement. 


Participant  #10. 

Defend  in  Europe  outnumbered! 

Participant  #11. 

We  assume  a  steady  influx  of  C^l  and  its  processing  use  are  steady.  Info 
overload  is  a  bogeyman. 

Participant  #12. 

I  lack  the  experience  at  corps  and  echelons  above  corps  to  make  any  construc¬ 
tive  comments  here. 

Participant  #13. 

European. 

Participant  #14. 

Europe  came  to  mind;  i.e.,  marginal  weather,  long  visibility  lines,  mecha¬ 
nized  formations  and  large  forces.  Decisions  were  made  very  quickly  with 
fairly  limited  information,  somewhat  realistic. 

Participant  #15. 

Northwest  Europe.  German  Eastern  Front  WW2.  Thick  operations  with  proximi¬ 
ties  to  reinforce  success  by  the  imposition  of  combat  power. 

Participant  #16. 

I  felt  my  decisions  were  swayed  toward  the  European  scenario.  Emphasis 
within  the  Army  sways  all  thinking  toward  Europe  and  current  deep-attack 
doctri ne. 

Participant  #17. 

The  scenario  which  came  to  mind  was  a  conventional  battlefield  in  Europe. 

The  "Fulda  Gap"  scenario  relate  to  the  decision  process  used  by  me  in  the 
experience. 

Participant  #13. 

Scenario  seems  purely  a  NATO/WARSAW  Pact  confrontation. 
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Participant  #19. 

None  comes  to  mind. 

Participant  #20. 

Whether  enemy  is  Soviet,  3d  world  or  other  power. 

Participant  #21. 

I  envision  a  mechanized  corps  in  the  European  theater  engaging  a  Soviet 
force  of  equal  size. 

Participant  #22. 

Given  the  wide  spectrum  of  geographic  areas  where  the  US  Army  possibly  can 
be  employed  in  the  mid-  to  high-intensity  operations,  our  decision  process 
is  a  function  of  training  in  the  European  setting.  If  this  in  fact  the 
case,  a  general  setting  should  be  presented  at  the  outset.  Exainple--the 
risk  associated  with  a  reserve  corps  which  is  engaged  at  a  friendly/enemy 
ratio  is  higher  in  the  faster  pace  mech  battlefield  than  the  low-  to 
mid-intensity  nonmechinized  scenario  such  as  Pacific  Theater  Operations 
during  WWII.  Net  allocations  of  CAS/CSS  would  change  where  a  higher  risk 
is  associated. 

Participant  #23. 

Echeloning  has  no  meaning.  Questions  difficult  to  answer  without  a  feeling 
of  the  flow  of  initiative,  overall  long  range  intent  (strategic/operational ) , 
and  the  unit  coherence  of  the  forces. 

Participant  #24. 

What  do  you  do  with  late  arriving  forces  in  Europe  if  the  war  has  started? 

Do  you  really  want  to  throw  a  newly  arrived  division  into  a  corDS  (reserve 
or  online)  that  is  engaged,  regardless  of  the  force  ratio?  The  only  situa¬ 
tion  is  if  survival  of  the  whole  army  is  at  stake. 

Participant  #25. 

One  more  time— what  do  I  want  to  accomplish?  Strategic  defense  of  specific 
terr i tory--destruction  of  a  military  force--sei zure  of  an  area?  Other  fac¬ 
tors:  combat  power  ratio  sustainabi 1 i ty. 

Participant  #26. 

No  specific  scenario  or  situation;  but  literally  Hundreds  of  :uses,  all 
si igntly  different. 

Participant  427. 


A  number  of  1950-53  Korean  War  scenarios  come  to  nin  1;  i  few  from  Vietnam. 
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Participant  #28. 

Tendency  was  to  be  as  aggressive  as  prudently  possible--mostly  defending  at 
1:3  and  at  least  defending  if  not  attacking  at  1:1  or  3:1.  Dependent  on 
criticality,  stage  of  battle,  etc. --given  more  data,  weather,  terrain, 
etc.--I  occasionally  attack  at  1:3  if  surprise  could  be  achieved.  A  pro¬ 
typical  scenario  does  come  to  mind.  I  once  ran  a  convoy  down  a  completely 
VC  held  road  that  had  not  been  used  by  US  for  4  years.  Successfully  (since 
they  were  the  sole  users  we  did  not  worry  about  mines!).  I  would  only  do 
that  once  however.  There  is  applicability.  A  Soviet  who  perceived  he  in 
fact  had  3:1  superiority  in  the  attack  (though  he  tries  for  5  or  6:1)  cer¬ 
tainly  would  be  prepared  to  defend.  Generally,  these  decisions  can  be 
"canned",  but  a  delphi  factor  (and  sometimes  a  big  one)  must  be  cranked  in. 

Participant  #29. 

1.  Cannot  believe  there  would  be  a  situation  where  we  would  not  know  the 
unit's  mission  and  amount  of  internal  fire  support  it  possessed. 

2.  Given  only  information  presented  I  tended  to  be  more  aggressi ve--anytime 
had  3:1  odds  I  tended  to  attack  if  the  Army  was  doing  anything  but  delay. 

3.  I  tended  to  think  in  terms  of  European  environment  and  terrain  when 
considering  scenarios. 

Participant  #30. 

I  put  the  decisionmaking  process  in  the  European  scenario,  specifically  V 
Corps.  Regarding  CSS  I  feel  support  of  engaged  units  is  most  important;  in 
priority  attacking  units,  defending  units,  and  delaying  units.  I  put  high 
priority  on  units  reconstituting  in  the  rear. 

In  placing  artillery  I  put  it  where  it  is  needed  to  fire  most--never  keep 
it  in  reserve.  Heaviest  support  to  the  attack.  V  Corps  has  little  ground 
it  can  give  up  before  the  path  is  open  to  Frankfurt  and  the  Rhine  so  all 
support  possible  should  be  put  to  assist  the  defense  and  assure  success  on 
the  offense. 


The  corps  posture  was  most  difficult.  WINTEX  last  year  put  us  through  sim¬ 
ilar  situations  and  it  was  difficult  to  know  what  CENTAG  was  doing  and  what 
the  plan  was  beyond  96  hours.  Good  exercise. 
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Participant  #31. 

The  selection  of  a  corps  posture  was  more  easy  to  envision  and  conceptualize 
than  the  assignment  of  a  new  artillery  unit  based  on  my  knowledge  of  current 
war  plans  and  specifically  the  European  theater. 

If  one  postulates  that  a  European  war  would  erupt,  with  adequate  warning 
signs,  to  begin  the  necessary  reinforcement  and  mobilization,  and  that  rein¬ 
forcement  corps  would  be  available,  then  the  decision,  on  where  and  how  to 
employ  the  corps  would  be  a  function  of  what  point  in  the  war  we  are  in. 
Battle  management  decisions  based  on  METT-T  would  largely  dictate  our 
actions  and  could  very  well  be  based  on  the  variables  considered  in  this 
experiment. 

I  find  it  difficult  to  envision  an  artillery  unit  not  being  assigned  to  a 
division  or  corps  artillery  from  the  outset,  i.e.,  artillery  is  not  held  in 
reserve. 

Participant  #32. 

Yes,  the  battalion  management  scenarios  taught  at  Ft.  Leavenworth. 

Participant  #33. 

Company  and  battalion  ARTEPX  in  Europe  came  readily  to  mind,  and  I  envisioned 
corps  activities  using  that  analogy. 

Participant  #34. 

I  guess  the  thing  that  comes  to  mind  is  an  army  group  operating  in  Europe 
against  the  classic  Warsaw  Pact  all-out  conventional  attack.  Only  in  that 
scenario  are  you  going  to  encounter  the  situations  described  in  my  mind. 

In  general,  I  thought  the  test  did  not  provide  enough  information  on  each 
scenario  or  situation.  The  modern  commander  is  saturated  with  multiple 
data  upon  which  to  base  a  decision  of  the  type  described  here. 

Participant  #35. 

Hell,  I  am  working  my  way  from  active  defense  to  Airland  battle  in  an  army 
that  is  rapidly  modernizing.  The  Russians/enemy  will  always  have  the  advan¬ 
tage  of  the  initiative.  I  will  always  try  to  take  that  away  from  him.  AL3 
gives  me  that  opportunity  as  does  the  combat  power  being  generated  from  new 
systems  being  fielded. 

Participant  #36. 

Yes--Ass i gnment  of  priority  of  fire.  Based  on  mission,  status,  commanders 
estimate,  a  particular  unit  is  assigned  priority  of  artillery  fires.  That 
is,  we  will  answer  that  unit's  calls  first. 
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Participant  #37. 

The  major  concern  in  the  CSS  battle  management  decision  is  the  underlying 
assumption,  given  the  condition  of  an  engaged  reserve,  that  the  situation 
is  critical,  assuming  no  other  corps  in  reserve.  At  this  point,  CSS  to  all 
elements  is  paramount  to  preclude  catastrophic  consequences. 

Participant  #33. 

Based  on  my  professional  education  and  "always  facing  the  Soviets  in  Europe,' 
the  European  scenario  came  to  mind.  The  answer  is  yes,  because  your  scen¬ 
ario  left  so  much  to  my  imagination. 

Participant  #39. 

Only  one  comment--when  making  decisions  at  corps  or  above,  all  aspects 
(forces)  in  the  conflict  must  be  considered,  since  it  is  a  given  that  the 
Army  will  not  fight  any  war  by  itself. 

Participant  #40. 

AFCENT  scenario  comes  to  mind  where  current  reserves  and  their  location  are 
a  constant  factor  to  be  considered  both  in  defense  and  in  the  main  attack. 
Example:  In  Europe  where  Warsaw  Pact  makes  2  or  3  main  attacks,  you  must 
determine  where  his  reserves  (follow-on  forces)  are  and  where  your  reserves 
are. 
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OTHER  COMMENTS 


Participant  #1. 

At  the  risk  of  showing  my  ignorance,  it  seems  that  the  112  situations  in 
the  battle  management  decision  to  assign  a  division  were  repetitious.  I 
felt  I  was  repeating  my  decisions. 

Participant  #2. 

1.  There  was  not  sufficient  data  on  which  to  make  decisions. 

2.  Decisions  relating  to  army  objective  and  corps  posture  could  only  be 
made  if  mission  of  corps  in  relation  to  army  mission  is  known. 

3.  Priority  of  CAS  &  CSS  could  only  be  meaningful  given  corps  mission  and 
enemy  threat  (force  ratios). 

4.  Without  knowing  status  of  supply  of  corps,  meaningful  decision  on  prior 
ity  of  supply  could  not  be  made. 

Participant  #3. 

This  model  is  asking  the  user  to  assign  missions  to  a  corps--however ,  not 
enough  information  is  given  on  the  higher  level  campaign  plan  to  make  such 
a  "mission"  decision. 

Participant  #4. 

I'm  not  comfortable  with  what  I  did--not  sure  that  I  fully  understood  what 
answer  you  really  wanted  to  get. 

Participant  #5. 

As  an  Air  Force  type.  I'm  not  sure  the  information  has  any  value-- I  suspect 
not  much.  May  want  to  disregard  my  input. 

Participant  #6. 

The  decision  model  as  prototyped  does  not  provide  some  other  basic  informa¬ 
tion  required  for  effective  decisionmaking. 

Participant  ?7. 

More  thorough  introduction  to  testing  is  needed. 

Requi rements/terms  need  to  be  clearly  defined. 
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Participant  #8. 

Would  help  to  identify  a  benchmark  for  first  question.  In  exercise  at  Degin 
ning,  my  value  for  the  first  question  was  zero.  Subsequent  questions  and 
solutions  were  even  less  critical.  However,  I  could  not  assign  a  lower 
val ue. 

Participant  #9. 

I  had  a  vague  idea  of  what  I  was  doing  using  the  computer--but  this  question 
naire  has  me  completely  befuddled,  and  there  does  not  seem  to  be  anyone 
present  to  answer  our  questions. 

Participant  #10. 

Could  be  used  as  an  excellent  teaching  aid,  but  a  preferred  response  (answer 
to  each  question  would  be  necessary.  Best  to  play  in  a  particular  scenario. 

Participant  #11. 

This  is  a  waste  of  time  and  money!  When  I  think  of  all  the  programs  in  the 
Army  which  have  not  been  funded  or  which  have  been  bill  payers  so  we  can  do 
these  kinds  of  things,  I  am  incensed! 

Decisions  as  done  in  the  model (s)  are  made  by  commanders  (humans)  who  meas¬ 
ure  hundreds  of  variable  which  you  can  never  capture  nor  weight  in  a  model- 
-i.e.,  strengths  and  weakness  of  subordinate  commanders,  value  of  terrain 
and  good  tactics,  etc. 

I  am  not  anticomputer,  but  they  have  a  role  in  information  management  not 
in  this  kind  of  decisionmaking  for  the  running  of  scenarios.  It  would  be 
a  garbage-in/garbage-out  drill  and  I  am  afraid  important  decisions  in  Army 
are  too  often  made  on  garbage  data. 

Participant  #12. 

I  found  this  exercise  frustrating  and  worthless. 

This  experiment  was  the  biggest  waste  of  time  I  have  engaged  in  in  my  21 
years  in  the  Army. 

Participant  ?13. 

I  may  not  have  understood  the  question  or  assignment  of  corps. 

Participant  #14. 

You  must  consider  your  logistics  support. 
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Participant  #15. 

Trying  to  reduce  subjective  decisions  to  objective  decisions  is  difficult 
at  best.  Taking  answers  and  using  them  as  standard  with  limited  information 
to  start  decreases  the  validity  of  the  answer,  even  it  comes  out  with  a 
good  number  and  a  small  standard  deviation  for  a  large  sample  size  of  random 
volunteers. 


Participant  #16. 

Ratio  of  1  corp  FA  bn/Div  is  the  best  the  scenario  got.  In  fact,  we  doctrin¬ 
al  ly  operate  at  1  FA  Bde/Div  1  FA  Bde  =  2-4  FA  bns.  Therefore,  al 1  situa¬ 
tions  required  a  pretty  high  degree  of  criticality. 

Participant  #17. 


Your  questionnaire  seizes  on  too  simple  aspects  of  the  overall  problem. 
You  could  set  the  form  parameters  of: 


ATTACK  DEFEND  DELAY  WITHDRAW 

then  the  engagement/nonengagement,  then  the  force  ratio;  and  set  up  your 
specific  questions  within  those  3  parametric  forms,  looking  for  criticality 
issues  against  specific  battle  management  factors. 

Not  enough  information  for  many  questions  to  derive  val id  and  rel i able 
results  from  your  respondents. 

Participant  #18. 

Good  ideas,  but  much  work  needs  to  be  done. 

Participant  #19. 

Some  background  (read-ahead  material)  and/or  a  "take  home"  exercise  describ¬ 
ing  the  purpose  of  this  endeavor  and  providing  more  details  which  could  be 
digested  prior  to  answering  the  computer  questions  and  this  data  collection 
exercise  would,  perhaps,  provide  CAA  with  more  meaningful  input. 

Participant  #20. 

The  artificiality  of  the  data  available  to  the  decisionmaker  bothers  me. 

The  terms  "Army  Objective  Phase  Line"  is  a  non  term.  Phase  lines  are  used 
to  control  portions  or  phases  of  an  operation.  So  using  that  term  indicated 
a  phased  operation  with  actions  either  preceding  or  following. 

What  leaders  (or  simulated  leaders)  were  being  asked  to  decide  these 
questions? 


Phase  lines  can  be  changed  where  a  situation  arises  that  odds  are  favorable 
for  attack  (3:1)  or  revised  rearward  where  overwhelming  odds  are  encountered. 


E  -  33 


CAA-SR-86-5 


Participant  #21. 

The  computer  "trials"  probably  brought  out  my  bi asses  mainly  as  "force- 
ratio"  requirements--as  I  remembered  them  from  my  infantry  school  days. 
Understood  what  3MD  #2  was  leading  to;  somewhat  confused  about  purpose  of 
BMD  #5.  The  added,  written  part  (here)  left  me  more  confused  about  the 
purpose  of  it  all. 

Participant  #22. 

I  wonder  if  this  approach  to  investigation  of  pertinent  factors  will  bear 
and  substantive  fruit?  Could  be  validated  in  any  way?  Could  be  use  credibly 
to  support  operational  decisions? 

Participant  #23. 

Your  terminology  needs  to  be  brought  in  line  with  Army  terms.  We  do  not 
use  echelons  or  postures.  What  is  an  Army  objective  phase  line?  The  person¬ 
nel  conducting  the  test  seemed  vague  about  the  model  and  the  test.  That's 
embarrassing  to  CAA ! ! 

Participant  #24. 

I  get  the  impression  that  these  rules  are  a  continuation  of  our  reliance  on 
ratios  determine  outcomes  because  of  our  inability  to  model  combat  above 
the  level  of  one-on-one  engagements. 

Participant  #25. 

Exercise  is  not  beneficial  in  my  opinion.  It  is  limited  in  scope  and  opin¬ 
ion  oriented  based  upon  one's  own  perception  of  what  situation  is. 

Participant  #26. 

It  would  be  interesting  to  see  the  consolidated  results. 

Participant  #27. 

Difficult  to  provide  best  answer  without  the  availability  of  additional 
parameters. 

Participant  #28. 

I  was  often  confused  as  to  the  location  of  reserve  corps.  I  did  not  know 
what  was  meant  when  you  had  a  corps  in  reserve  and  you  had  the  decision  to 
make  on  the  importance  of  another  reserve  corps.  Did  we  double-stack  or 
assume  the  original  reserve  corps  would  deploy? 
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In  first  simulation  (online  corps  and  reserve  assignment),  it  was  confusing 
not  to  know  status  of  army,  e.g.,  how  many  corps  were  already  in  the  army 
including  or  excluding  the  one  in  reserve.  In  the  CAS  assignment  situation 
the  notion  of  3d  echelon  (refurbishment)  was  totally  foreign  to  my 
experience.  I  was  unsure  what  the  situation  of  3d  echelon  was  meant  to 
convey. 

Participant  #30. 

The  scenarios  chosen  were  too  simplistic  and  lacked  sufficient  detail. 

Engaged--ammo  resupply  100  critical. 

Refurbishment--maintentance  support  100  critical. 

Conclusion:  resolution  not  fine  enough  for  valid  decisions.  Too  much  mis¬ 
sing  data. 

Participant  #31. 

When  an  individual  is  asked  to  allocate  CSS,  CAS,  etc.,  it  depends  on  whet¬ 
her  or  not  the  follow -on  echelons  (81ue/friendly)  are  being  engaged  in  a 
deep  battle/rear  battle  scenario,  or  if  an  attrition  battle  (old  style 
planning/doctrine)  has  worn  down  or  warn  away  1st  and  2d  echelon  forces. 

Participant  #32. 

There  are  many  more  factors  that  come  to  mind  in  making  decisions.  I  tried 
to  <eep  those  out  of  mind  when  making  decisions  on  this  exercise. 

Participant  #33. 

I  honestly  believe  my  input  will  be  of  little  value  due  to  a  lack  of  under¬ 
standing  of  what  this  drill  was  all  about. 

Participant  #34. 


Questions/si tuation  too  general  for  specific  without  having  other  infor¬ 
mation;  e.g.,  enemy  status,  other  units  (left/right  flank),  reserves. 
Would  do  better  at  answering  question  with  some  general  background 
information. 


CAA- SR -36- 5 


APPENDIX  F 

SUMMARY  OF  QUANTITATIVE  RESPONSES  TO  QUESTIONNAIRE 


This  appendix  contains  a  summary  of  the  quantitative  responses  of  subjects 
obtained  from  administration  of  the  questionnaire  of  Appendix  0.  This  sum¬ 
mary  is  a  product  of  the  US  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences  (ARI),  the  developer  of  the  questionnaire. 
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RfRLY  TO 
ATTENTION  Of 


DEPARTMENT  OF  THE  ARMY 

US  ARMY  RESEARCH  INSTITUTE 
6001  EISENHOWER  AVENUE 
ALEXANDRIA.  VIRGINIA  22333-6600 

May  9,  1986 


Systems  Research  Laboratory 


Dr.  James  J.  Metzger 

U.S.  Army  Concepts  Analysis  Agency 

8120  Woodmont  Avenue 

Bethesda,  Maryland  20814 

Dear  Dr.  Metzger: 

We  have  now  completed  the  initial  examination  of 
the  FORCEM  questionnaire  administered  to  students  from 
the  U.S.  Army  War  College  as  part  of  your  experimental 
Investigation  of  decision  rules.  The  following  obser¬ 
vations  and  data  are  provided  for  your  consideration 
and  incorporation  into  the  final  study  report. 

Background 

A s  you  know,  our  interest  in  this  project  cen¬ 
tered  around  gaining  a  better  understanding  of  how 
military  officers  approach  various  battle  management 
decisions.  Like  you,  we  Wished  to  determine  the  rela¬ 
tive  influence  of  different  FORCEM  variables  on  each 
type  of  battle  management  decision.  In  addition, 
however,  we  were  interested  in  determining  the  ade¬ 
quacy  of  these  variables  for  representing  real-world 
combat  situations.  That  is,  does  the  representation 
of  battle  management  problem  in  FORCEM  consistently 
match  the  training  and  experience  of  the  military 
subjects.  Here,  significant  deviations  from  real-world 
experience  might  indicate  the  need  for  modifications 
to  the  way  in  which  information  is  provided  to  model 
gamers . 

Other  questions  of  interest  in  this  experiment 
included  (1)  how  consistent  are  the  derived  regression 
weights  with  the  subject  importance  beliefs,  (2)  what 
additional  variables  were  considered  important,  (3)' 
how  uncertain  were  different  variables  believed  to  be 
under  real-world  conditions,  and  (4)  how  scenario- 
dependent  were  different  variables  believed  to  be. 


CAA-SR-86-5 


-2- 


Findings 

(A)  Relative  Importance  of  Independent  Variables 
Descriptive  statistics  were  generated  on  the  responses 
provided  by  the  military  subjects  and  are  summarized 
in  Table  1.  From  these  data  it  is  noted  that  there 
Is  a  great  deal  of  consistency  between  the  average 
subjective  ranking  In  importance  of  the  independent 
variables  and  the  regression  weights  derived  from  your 
quantitative  analysis.  For  example,  four  out  of  the 
top  five  subjectively-ranked  variables  appear  as  sig¬ 
nificant  main  effects  in  each  of  the  regression  equa¬ 
tions  : 


-  Corps  force  ratio 

-  Corps  engagement  status 

-  Echelon  to  which  Corps  is  assigned 

-  Corps  location  and  posture 

Other  main  effects  selectively  appearing  in  indi¬ 
vidual  regression  equations  (ratio  of  artillery  to 
divisions  and  echelon  to  which  division  is  assigned) 
can  be  attributed  to  the  specific  nature  of  those 
decisions . 

One  should  be  cautious,  however,  in  viewing  the 
average  subjective  ranking  data  from  this  experiment. 
Again  from  Table  1  it  is  noted  that  most  of  the  inde¬ 
pendent  variables  have  a  fairly  large  variance  in 
importance  across  the  military  population.  What  this 
Implies  is  that  consideration  of  a  particular  variable 
tends  to  be  very  idiosyncratic  — varying  with  both 
the  decision  and  the  individual.  For  example,  for  the 
top  three  main  effect  variables,  the  following  distri¬ 
butions  of  beliefs  were  obtained: 
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Importance 

High 

Moderate 

Corps 

force  ratio 

64 

10 

Corps 

engagement  status 

58 

13 

Echelon  to  which  Corps  is 

37 

30 

assigned 

From  the  written  comments  obtained  from  the  sub¬ 
jects,  we  identified  six  additional  areas  of  informa¬ 
tion  thought  to  be  important  in  the  battle  management 
process.  These  areas  of  information,  rank-ordered  by 
their  frequency  of  being  mentioned,  include  the  fol¬ 
lowing: 

-  Availability  of  combat  resources  /  combat 

strength 

-  General  assessment  of  the  battlefield  situa 

tion 

-  Quality  of  combat  resources  /  readiness  / 

morale 

-  Terrain  /  weather  /  mobility  factors 

-  Strategy  /  military  objectives  /  assigned 

mission 

-  Status  of  enemy  forces 

-  Availability  of  intelligence  assets  /  commu 

nlcations 

For  the  future,  you  should  give  consideration  as 
to  how  these  types  of  data  can  be  realistically  pro¬ 
vided  to  the  gamer /decis ionmakers . 

(B)  Realism  of  Independent  Variables 

A  number  of  the  Independent  variables  were  viewed 
as  being  somewhat  artificial  or  artifacts  of  the 
mathematical  representations  in  FORCEM,  as  indicated 
by  the  mean  realism  scores  in  Table  1.  It  is  recom¬ 
mended  that,  for  the  future,  you  consider  how  certain 
variables  (say,  those  with  a  mean  realism  score  below 
0.85)  be  represented  to  game r s / deci s i onmake r s  in  a 
more  realistic  manner.  These  variables  include  the 
following : 


-  Corps  force  ratio 

-  Division  combat  worth  force  ratio 

-  Echelon  to  which  Corps  is  assigned 

-  Corps  status  and  number  of  Corps  behind 

-  Number  of  Corps  in  reserve 

-  Have  2nd  echelon  divisions  been  committed 

-  Number  of  combat  ready  divisions  in  1st,  2nd 

echelon 

-  Ratio  of  current  artillery  to  current 

divisions 

-  Echelon  to  which  division  is  assigned 

-  Support  status  of  reserve  Corps 

Two  particular  issues  frequently  noted  in  the 
written  comments  were  (1)  the  term  "echelon"  has  no 
valid  meaning  with  reference  to  U.S.  forces  and  (2)  it 
was  hard  to  Imagine  a  situation  in  which  the  theater 
commander  would  have  the  luxury  of  holding  an  entire 
Corps-size  unit  in  reserve.  These  comments  poten¬ 
tially  explain  the  low  realism  scores  for  those  varia¬ 
bles  which  make  some  reference  to  either  echelon  or 
reserve  forces. 

The  low  realism  scores  of  the  two  "force  ratio” 
variables  are  possibly  due  to  the  difficulty  of  trans¬ 
lating  this  type  of  mathematical  term  into  precise 
real-world  examples  or  illustrations. 

(C)  Degree  of  Uncertainty 

Military  officers  realize  that  they  will  have  to 
deal  with  some  degree  of  uncertainty  in  their  availa¬ 
ble  information  during  wartime.  From  Table  1  it  is 
noted  that  a  number  of  the  variables  have  a  fairly 
high  degree  of  uncertainty  anticipated  with  them. 

These  include 

-  Corps  force  ratio 

-  Division  combat  worth  force  ratio 

-  Have  2nd  echelon  divisions  been  committed 

-  Number  of  combat  ready  division  in  1st,  2nd 

echelon 
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-  Is  on-line  Corps  holding  up  advance  of 

adjacent  Corps 

-  Support  status  of  reserve  Corps 

A  slight  degree  of  correlation  (r  -  0.329)  is 
noted  between  the  realism  rating  and  uncertainty  rat¬ 
ing  for  division  combat  worth  force  ratio.  However, 
it  is  not  possible  to  ascertain  whether  the  realism 
rating  had  any  influence  on  the  uncertainty  rating  for 
this  variable.  Nothing  in  the  written  comments  would 
suggest  any  subjective  connection  of  these  two  rat¬ 
ings.  On  the  other  hand,  ratings  of  realism  and  un¬ 
certainty  for  Corps  force  ratio  were  generally 
uncorrelated  (r  -  0.154). 

Written  comments  suggest  two  prevalent  strategies 
for  coping  with  information  uncertainty:  (1)  making  a 

"best  guess"  estimate  of  the  situation  or  specific 
variable  and  (2)  taking  a  more  conservative  approach 
to  planning  and  decision  making.  This  would  suggest 
that  future  employment  of  the  FORCEM  model  ought  to 
give  some  consideration  to  treating  information  uncer¬ 
tainty  as  an  independent  variable  so  that  its  impact 
on  battle  management  strategy  can  be  more  accurately 
assessed. 

(D)  Scenario  Dependence 

Data  from  Table  1  suggest  that  a  considerable 
number  of  the  variables  are  viewed  as  being  moderately 
scenario-dependent.  That  is,  the  officers  rated  their 
relative  importance  to  different  decisions  as  being 
dependent  upon  whether  or  not  a  European,  Korean, 
Southwest  Asian,  etc  scenario  was  being  considered. 
This  finding  suggests  that  (1)  consideration  be  given 
to  using  different  regression  weights  for  specific 
theaters  of  operation  and  (2)  future  experiments  on 
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Degree  pf 

Degree  of 

Scenario 

Iaportance 

Realise 

Certainty 

Dependence 

Independent  Variable 

Hean 

Std  Dev 

lean 

Hean 

(lean 

Corps  Force  Ratio 

2.82 

0.453 

0.34 

0.63 

0.67 

Corps  Engagement  Status 

2.70 

0.589 

0.96 

0.35 

0. 47 

Division  Coe bat  north  Force  Ratio 

2.A5 

0.773 

0.76 

0.56 

0.62 

Echelon  To  Which  Corps  Is  Assigned 

2.37 

0.690 

0.70 

0.91 

0.49 

Corps  Location  and  Posture 

2.36 

0.605 

0.92 

0.9C 

0.61 

Division  Engageeent  Status 

2.3A 

0.793 

0.95 

0.77 

0.63 

Current  Posture  of  Corps’  Parent  Arny 

2.29 

0.649 

0.86 

0.30 

0.49 

Corps  Status  and  Nuaber  of  Corps  Behind 

2.24 

0.709 

0.73 

0.83 

0.45 

Nuaber  of  Corps  in  Reserve 

2.18 

0.328 

0.80 

0.36 

0.58 

Have  2nd  Echelons  Been  Coaaitted 

2.15 

0.860 

0.81 

0.68 

0.59 

Location  of  Arty  Objective  Phase  Line 

2.13 

0.618 

0.86 

0.B3 

0.81 

Number  of  Coabat  Ready  Divisions  in  1st,  2nd  Ech 

2.12 

0.879 

0.77 

0.73 

0.48 

Ratio  of  Current  Artillery  to  Current  Divisions 

2. 04 

0.840 

0.85 

0.78 

0.61 

Echelon  to  Which  Division  Is  Assigned 

2.00 

0.300 

0.76 

0.77 

0.53 

Is  'In-Line  Corps  Holding  Up  Advance  of  Adj  Corps 

1.84 

0.767 

0.38 

0.59 

0.59 

Support  Status  of  Reserve  Corps 

1.32 

0.743 

0.84 

0.70 

0.42 

Degree  of  Realise.  1.00  -  Real-aorld  Data  0.00  =  Artifact  of  Siauiation  Nocel 

Degree  of  Certainty  1.0C  =  Hard  Data  0.50  =  federate  Uncertainty  0.00  =  Unknown 

Scenario  Deoenaence  1.00  *  Scenario-specific  Variable  O.QG  =  Context-free  Variable 


TABLE  1 
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APPENDIX  G 

PILOT  EXPERIMENT 


This  appendix  contains  data  supporting  the  pilot  experiment  documented  in 
Chapter  3  of  the  main  report. 


I.  I  h  e  r  e  is  currently  at  l  »  a  s  t  cne  CORPS  assicred  in  reserve 

behind  the  ONLINE  CORPS. 

l  .  Hr  ONLINE  CORPS  is  cirrently  en'annr. 

J.  the  location  of  the  parent  Amy's  Objective  chase  line  is  now  located 
at  the  present  position  of  the  ONLINE  CORPS'  current  forward  phase  line 

4  •  Assuaira  all  Divisions  currently  assigned  to  the  Oh'LINF  CORPS 
are  in  place,  the  currert  posture  of  the  ONLINE  CORPS  i  «  detrrr. 

5.  Assuairq  all  Divisions  currently  assigned  to  ONLINE  CORPS 
are  in  place,  the  f r i e nd  l y - 1 o - e ne m y  combat  vorth  force  ratio 
is  Currertly  perceiver  to  be  F  R  I  F  NO  :F  N  E  P  V  Cl::,) 

PLEA  IE  RE5FCND  E)  EhtFRIhf  A  NLPFER  BETWEEN  C  A  ►  D  100 
tasefl  or  the  follcvino  scale  of  hov  criticat 
you  thirk  it  is  tor  the  newly  arrived  CORPS 
t  e  jssicned  to  reserve  status  behind  the 
INLINE  fORPS.  Alter  enteriro  a  number  hit  '  AM I T ' . 


0 

1  ( 

cC 

1  1 

4  0 

1  ( 

6  r 

1  1 

en 

1  1 

ICO 

1 

1  1 

NCI 

1  t 

SLI6MLS 

t  1 

pcderaifly 

1  1 

VERY 

1  1 

E  AYR  F  PEL  Y 

1 

C  R  I  11  l  A  l 

CR  I  1  I  CAI 

CR  1  1  I  CAL 

CRITICAL 

CRITICAL 

Figure  G-l.  Sample  Question 
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Table  G-l.  Cell  Means  -  Pilot  Experiment 


1 

2 

3 

4 

5 

6 

31 

36 

43 

43 

65 

91 

13 

18 

25 

13 

25 

43 

36 

45 

62 

55 

67 

96 

19 

22 

33 

28 

34 

53 

13 

20 

25 

27 

32 

73 

6 

9 

17 

9 

13 

31 

18 

31 

30 

38 

43 

79 

11 

13 

15 

15 

13 

40 

Grand  mean  =  34 


Table  G-2.  Marginal  Means  -  Pilot  Experiment 


Level s 

Factors  1  2 I  3  ” 
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Table  G-3.  ANOVA  Table  -  Pilot  Experiment 


Source 


Degrees  of 
freedom 


Sum  of 
squares 

Mean 

square 

F-ratio 

25,696 

26,696 

43.05 

5,084 

5,084 

6.13 

59,127 

59,127 

131.10 

98,385 

19,777 

36.35 

203 

203 

1.73 

1,649 

1,649 

16.71 

1,010 

202 

1.32 

118 

113 

1.47 

222 

44 

0.29 

10,023 

2,005 

6.52 

73 

78 

0.37 

469 

94 

0.71 

951 

190 

1.34 

667 

133 

1.14 

345 

69 

0.47 

48,974 

6,122 

79.73 

4,961 

620 

8.08 

6,580 

823 

10.72 

3,608 

451 

5.88 

21,764 

544 

7.09 

938 

117 

1.53 

790 

99 

1.29 

6,115 

153 

1.99 

643 

30 

1.25 

6,098 

152 

1.99 

12,290 

307 

4.00 

1,695 

217 

2.76 

5,304 

133 

1.73 

4,131 

103 

1.35 

4,697 

117 

1.53 

5,315 

145 

1.39 

Level  of 
significance 


2,753 


icant  at  tne  0.05  level  of  significance. 


icant  at  tne  0.01  level  af  sioni-'icance. 
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APPENDIX  H 


EXPERIMENTAL  DATA 


This  appendix  contains  the  raw  data  collected  as  described  in  Chapter  5  of 
the  main  report. 
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Table  H-2.  Data  -  Decision 
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APPENDIX  I 


STATISTICAL  ANALYSIS 


This  appendix  contains  data  supporting  the  statistical  analysis  documented 
in  Chapter  6  of  the  main  report.  The  first  two  tables,  repeated  for  ease 
of  reference  from  Chapter  4  of  the  main  report,  list  the  factors  (i.e., 
perception  data  base  variables)  for  the  experiments,  and  the  levels  consid¬ 
ered  for  the  factors. 


Table  1-1.  Decision  Factors 


Symbol 


Interpretation 


A 

8 

C 

D 

E 

F 

G 

M 

N 

P 

R 

S 


Has  reserve  corps 
Corps  engagement  status 
Corps  force  ratio 

Location  of  objective  of  corps/posture  of  corps 

Echelon  to  which  corps  assigned/has  reserve  corps 

Echelon  to  which  corps  assigned 

Ratio  of  corps  artillery  battalions  to  divisions 

Location  of  objective  of  corps 

Posture  of  parent  army 

Division  engagement  status 

Division  force  ratio 

Echelon  to  which  division  assigned 
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Table  1-2.  Levels  of  Decision  Factors 

Level 

Factor 

1 

2 

3 

4 

5 

6 

A 

No  res 

Has  res 

B 

Not  eng 

Engaged 

C 

1:3 

1:1 

3:1 

D 

Rear/ 

Mi  thdr 

Reached/ 

Del  ay 

Reached/ 

Defend 

Fwd/ 

Del  ay 

Fwd/ 

Defend 

Fwd/ 

Attack 

E 

Reserv 

Onl ine/ 

Yes 

Onl ine/ 

No 

F 

Reserv 

Onl ine 

G 

1.00 

0.25 

M 

Rear 

Reached 

Forward 

N 

Del  ay 

Defend 

Attack 

P 

No 

Yes 

R 

1:3 

1:1 

3:1 

S 


First 


Second 


Third 
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Table  1-3.  Model  Measures 


Number 

Number 

Parsimony 

Adequacy 

Perspective 

of  cells 

of  params 

ratio 

mallow 

(c) 

(P) 

(p/c) 

(Cp) 

%  Variation  (R2) 
explained  by 


equation  I  means  |  (r/m) 


44 

47 

56 

54 

64 

32 

27 

33 

32 

43 

47 

76 

14 

18 

24 

21 

22 

45 

54 

47 

67 

61 

64 

32 

36 

41 

44 

51 

48 

82 

16 

20 

32 

23 

33 

55 

23 

32 

36 

36 

33 

64 

17 

19 

22 

20 

33 

56 

7 

6 

13 

11 

14 

36 

25 

30 

36 

37 

39 

72 

13 

20 

20 

35 

32 

60 

8 

3 

12 

12 

20 

29 

Table  1-5.  Marginal  Means  -  Decision  1 


Levels 


Degrees  of 

Sum  of 

Mean 

Source 

freedom 

squares 

square 

F-ratio 

Level  of 
significance 


A 

1 

1 

3 

1 

C 

2 

1 

D 

5 

2 

A3 

1 

AC 

2 

AD 

5 

BC 

2 

BD 

5 

CD 

10 

ABC 

2 

ABD 

5 

ACD 

10 

BCD 

10 

ABCD 

10 

T 

19 

2 

AT 

19 

3T 

19 

CT 

38 

DT 

95 

1 

ABT 

19 

ACT 

38 

ADT 

95 

3CT 

38 

3DT 

95 

CDT 

190 

A3CT 

38 

ABDT 

95 

ACDT 

190 

3CDT 

190 

BCDT 

190 

rror 

80 

Significant  at 

the 

0. 

*  Significant  at 

the 

0. 

6.2 
5.3 
<  1.0 
<  1.0 
<  1.0 
3.0 
<  1.0 
1.6 
2.0 
<  1.0 
1.5 


cance 

cance 

icance 
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Table  1-7.  Comparison  of  Models  -  Decision  1 


CtiLL.  KEAN  HANKXMG 

Figure  1-1.  Validation  -  Decision 


Source 


Degrees  of 
freedom 


Sum  of 
squares 


Mean 

square 


F-ratio 


8 

1 

26,685 

26,685 

19.4 

C 

2 

80,723 

40,361 

31.8 

D 

5 

375,844 

75,169 

42.0 

E 

2 

42,030 

21,015 

7.3 

3C 

2 

80,199 

40,100 

33.4 

80 

5 

2,139 

423 

1.4 

BE 

2 

2,328 

1,164 

2.1 

CD 

10 

105,413 

10,541 

19.9 

CE 

4 

15,439 

3,860 

8.7 

DE 

10 

6,975 

698 

2.2 

BCD 

10 

32,384 

3,238 

7.8 

BCE 

4 

2,023 

506 

1.1 

BDE 

10 

3,583 

359 

1.3 

CDE 

20 

28,240 

1,412 

4.4 

BCDE 

20 

57,184 

2,859 

8.0 

T 

19 

307,374 

16,178 

133.9 

BT 

19 

26,075 

1,372 

11.4 

CT 

38 

48,181 

1,268 

10.4 

DT 

95 

170,030 

1,790 

14.8 

ET 

38 

109,391 

2,879 

23.8 

BCT 

38 

45,613 

1,200 

9.9 

BDT 

95 

29,449 

310 

2.6 

BET 

38 

20,653 

543 

4*4 

CDT 

190  ■ 

100,656 

530 

4.4 

CET 

76 

33,925 

446 

3.7 

DET 

190 

59,100 

311 

2.6 

BCDT 

190 

78,527 

413 

3.4 

3CET 

76 

34,490 

454 

3.8 

BDET 

190 

52,258 

275 

2.3 

CDET 

380 

121,665 

320 

2.6 

BCDET 

380 

136,616 

360 

3.0 

Error 

30 

9,669 

121 

*  Significant  at  the  0.05  level  of  significance 
**  Significant  at  the  0.01  level  of  significance 
***  Significant  at  the  0.001  level  of  significance 
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Table  1-12.  Cell  Means  -  Decision  3 


40 

26 

53 

38 

45 

33 

62 

45 

52 

35 

58 

48 

46 

40 

55 

46 

46 

36 

57 

52 

48 

47 

71 

57 

71 

58 

76 

69 

72 

64 

37 

63 

77 

63 

87 

69 

69 

64 

77 

64 

71 

66 

80 

68 

78 

68 

86 

76 

Table  1-13.  Marginal  Means  -  Decision  3 


Levels 


Factors 


B 

47 

72 

0 

54 

59 

F 

55 

65 

G 

65 

54 

Overal  1 


• 

•1 

Degrees  of 

Sum  of 

Mean 

Level  of  \ 

|  Source 

freedom 

squares 

square 

F-ratio 

significance  j 

CELL  MEAN  RANKING 
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R 


Table  1-16.  Cell  Means  -  Decision  5 


C 


1 

2 

3 

F 

r 

1  i  2 

1 

2 

1 

2 

17  32 

14 

28 

7 

21 

68  80 

46 

64 

38 

54 

Table  1-17.  Marginal  Means  -  Decision  5 
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Table  1-18.  ANOVA  Table  -  Decision  5 


Source 

Degrees  of 
freedom 

Sum  of 
squares 

Mean 

square 

F-ratio 

Level  of 
significance 

8 

1 

93,497 

93,497 

35.3 

★  ★★ 

C 

2 

16,036 

8,018 

36.0 

★  ★★ 

F 

1 

14,055 

14,055 

33.5 

★  ★★ 

BC 

2 

4,014 

2,012 

15.6 

★  ★★ 

BF 

1 

10 

10 

<1.0 

CF 

2 

60 

30 

<1.0 

BCF 

2 

166 

83 

<1.0 

T 

20 

68,956 

3,448 

57.2 

8T 

20 

21,791 

13.1 

★  ★★ 

CT 

40 

8,903 

3.7 

★  ★★ 

FT 

20 

8,395 

7.0 

★  ★★ 

3CT 

40 

5,161 

129 

2.1 

★  ★★ 

BFT 

20 

3,817 

191 

3.2 

CFT 

40 

3,473 

37 

1.4 

BCFT 

40 

6,310 

158 

2.6 

★  ★★ 

Error 

34 

5,063 

60 

***  Significant  at  the  0.001  level  of  significance 


Table  1-19.  Comparison  of  Models  -  Decision  5 


PE  ORE  SSION 

MODEL 

PREDICTED 

V  A  LUE 

AND 

P  Fi  10  P  I  T  Y 

TELL 

ME  A  N 

CPI  TICAL 

INDEX 

AND 

PR  1 ORI T  Y 

ENCAGE  d 

FORCE 

RATIO 

ER  :E  N 

rCHELON 

1 

79 . 9 

1 

8  P.  3 

YES 

1  : 3 

PNL  INE 

2 

*5  .8 

y 

63.9 

YE  S 

1  : 1 

online 

1 

65  .  J 

T 

68.3 

YE  S 

1  : 3 

PESE  PVF 

M 

81.6 

u 

53.8 

YES 

3:1 

CNL  1  *:E 

50.8 

r 

M  5  •  6 

YE  S 

1  : 1 

RESERVE 

( 

36 . 7 

6 

38.1 

YES 

3  :  1 

PESE  PVE 

7 

32 .5 

7 

32.  3 

NO 

1  : 3 

PNL  I  >  t 

9 

27 .2 

P 

27.7 

NO 

1  : 1 

PNL  1  NE 

9 

22.0 

<3 

2  1.3 

NO 

3  : 1 

ONI  I  NE 

IP 

17.5 

ip 

16.9 

NO 

1  : 3 

RESERVE 

1  1 

12.3 

1 1 

13.9 

NO 

1  : 1 

reserve 

1  2 

7.  1 

l  ? 

7.0 

NO 

3  : 1 

RESERVE 
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Table  1-20.  Cell  Means  -  Decision  6 

C 


1 

? 

3 

1 

2 

1 

2 

1 

2 

36 

59 

30 

49 

21 

47 

69 

87 

57 

70 

52 

62 

Table  1-21.  Margin  Means  -  Decision  6 


Source 


Degrees  of 
freedom 


Sum  of 
squares 


Mean 

square 


F-ratio 


Level  of 
significance 


B 

1 

41,76i 

C 

2 

12,41 

F 

1 

20,52i 

BC 

2 

64. 

BF 

1 

1,46 

CF 

2 

11 

BCF 

2 

34 

T 

20 

61,26. 

BT 

20 

11,07 

CT 

40 

8,59' 

FT 

20 

7,99 

BCT 

40 

5,24 

BFT 

20 

4,84. 

CFT 

40 

3,54 

CFT 

40 

7,42 

ror 

34 

9,98 

Significant 

at 

the 

0.05  le 

★ 

Significant 

at 

the 

0.001  1 

1,760 

6,206 

0,520 

324 

1,467 

57 

173 

3,063 

554 

215 

400 

141 

242 

39 

186 


i gnif icance 
si  an  if icance 


Table  1-23.  Comparison  of  Models  -  Decision  6 


R  t  CP  r  S  S  I  0  N 

cell 

ENCAGE P 

FORCE 

echelon 

MODEL 

vE  an 

RATIO 

PR  IDTCTED 

CPTTICAL 

FR  :EN 

VALUT 

INDEX 

A  fl  D 

AND 

pp  ior  r  ty 

PR IORI T  T 

44 

29 

17 

42 

23 

14 

35 

21 

9 

88 

73 

71 

73 

61 

50 

52 

47 

37 

Levels 


P 

26 

61 

R 

54 

44 

33 

S 

56 

42 

33 
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Table  1-26.  ANOVA  Table  -  Decision  7 


Source 


Degrees  of 

Sum  of 

Mean 

Level  of 

freedom 

squares 

square 

F-ratio 

significance 

■  P 

1 

111,443 

111,443 

109.7 

R 

2 

24,483 

12,241 

32.3 

S 

2 

30,992 

15,496 

25.1 

PR 

2 

8,367 

4,183 

20.0 

PS 

2 

1,252 

626 

3.2 

RS 

4 

514 

128 

1.2 

PRS 

4 

451 

113 

<1.0 

T 

19 

32,029 

1,686 

15.8 

PT 

19 

19,302 

1,016 

9.5 

RT 

38 

14,384 

379 

3.5 

ST 

38 

23,459 

617 

5.8 

PRT 

38 

7,956 

209 

2.0 

PST 

38 

7,329 

193 

1.8 

RST 

76 

8,285 

109 

<1.0 

RST 

76 

11,579 

152 

1.4 

ror 

30 

8,553 

107 

Significant 

at 

the 

0.05  level  of 

significance 

Significant 

at 

the 

0.01  level  of 

significance 

★  « 

Significant 

at 

the 

0.001  level  of 

significance 

Table  1-27.  Comparison  of  Models  -  Decision  7 


REGRESSION 

CELL 

TNCAGE  n 

FORCE 

MO  CEL 

rE«N 

RA  TI  0 

Pf EDICTEr 

critical 

FR  :EN 

VALUE 

I N OF  X 

A  f.D 

AND 

PT  ICP  I  TY 

PRIORITY 

a_  or  uo 


57 

42 

33 

50 

35 

26 

41 

28 

25 

88 

78 

73 

71 

65 

66 

65 

55 

56 

Factors 
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Table  1-30.  ANOVA  Table  -  Decision  8 


Source 

Degrees  of 
freedom 

Sum  of 
squares 

Mean 

square 

F-ratio 

Level 
signif ic 

P 

1 

'  88,454 

88,454 

73.0 

R 

2 

16,802 

8,401 

13.9 

S 

2 

15,682 

7,841 

12.6 

★★★ 

PR 

2 

1,102 

551 

2.4 

PS 

2 

1,972 

986 

6.0 

★★★ 

RS 

4 

673 

168 

1.1 

PRS 

4 

385 

96 

<1.0 

T 

19 

60,233 

3,170 

8.6 

★  ★★ 

PT 

19 

23,038 

1,213 

3.3 

RT 

38 

16,862 

444 

1.2 

.  ST 

38 

23,613 

621 

1.7 

★ 

PRT 

38 

8,698 

229 

<1.0 

PST 

38 

6,227 

164 

<1.0 

RST 

76 

11,927 

157 

<1.0 

PRST 

76 

13,096 

172 

<1.0 

Error 

80 

29,399 

367 

*  Significant  at  the  0.05  level  of  significance 
***  Significant  at  the  0.001  level  of  significance 


Table  1-31.  Comparison  of  Models  -  Decision  8 


RE  GRF  SSI  ON 

MODEL 

PR  EDICTED 

value 

A  r.  Q 

PP  IOR I TY 


cei  l 
ME  »N 

CRITICAL 
INDE  * 

AND 

PR  I ORI T Y 


PNRAGE  P 


force 

RATIO 
F  R  :  E  N 


i 

OS. 9 

I 

8  7.8 

YE  S 

2 

77.6 

9 

7  1.1 

YE  S 

3 

72  .9 

2 

78.3 

YES 

3 

72 . 0 

3 

72  .8 

YE  S 

S 

69 . 2 

6 

6b. 3 

YE  5 

6 

6  9  .  U 

S 

65  .8 

YE  S 

6 

69 . 0 

7 

65.2 

YE  S 

9 

r  5  .  7 

9 

56.0 

YE  S 

0 

S5  .  7 

ID 

59  .8 

YE  S 

8 

c  9  *  5 

a 

56. 5 

NO 

1  1 

96.2 

1  1 

99.5 

NO 

1  7. 

9  1.0 

12 

92.0 

NO 

i  ; 

9  l  .  0 

IS 

32.5 

NO 

I  U 

37  .8 

1  3 

9  1  .2 

NO 

1  5 

32  .  7 

19 

39.8 

NO 

IS 

32  .  7 

1  7 

25. 6 

NO 

1  7 

79  .  3 

16 

27.5 

NO 

1  7 

79  .  3 

IP 

25.0 

NO 

EC  HI  LON 


FIRST 
r  I  R  S  T 
SECOND 
third 
first 

TH  1  RP 

SECOND 

TH  7  RP 

SECOND 

FIRST 

FIRST 

SECOND 

THIRD 

FIRST 

SECOND 

THIRD 

SECOND 

THIRD 
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APPENDIX  J 

SHORTCOMINGS  OF  FORCEM  C2 


J-l.  INTRODUCTION.  In  their  written  comments,  the  subjects  in  the  experi¬ 
ment  suggest  (explicitly  or  implicitly)  shortcomings  in  the  representation 
of  in  FORCEM.  So  also  do  Red  experts  through  discussions.  Such  sugges¬ 
tions  have  been  compiled  here,  rephrased  in  FORCEM  terminology. 

J-2.  READILY  FIXED.  The  concepts  listed  here  could  be  accommodated 
without  major  revisions  to  FORCEM. 

a.  Contingent  Change  in  Posture.  FORCEM  should  allow  for  a  change  in 
posture  "contingent"  on  the  situation,  e.g.,  a  unit  would  switch  from 
defending  to  attacking  when  sup^  iority  was  gained.  Such  logic  already 
exists  at  the  corps  and  division  levels.  At  the  army  level,  logic  could 
be  introduced  to  transition  between  master  plans  when  the  situation 
dictates. 

b.  Holding  Arriving  Division.  When  a  new  division  arrives  into  the 
theater  and  is  not  assigned  by  the  user  to  a  specific  corps,  then  logic 
internal  to  the  model  does  so.  There  should  be  the  capability  for  the  HQ 
making  the  decision  (the  theater  or  Army  HQ)  to  delay  the  assignment,  and 
thereby  maintain  a  reserve.  (See  also  paragraph  J-3g  below.) 

c.  Echelon  at  Which  Decision  Made.  Within  FORCEM,  the  decisions  on 
corps  type  of  operation  and  corps  organization  for  combat  are  made  by  the 
corps  itself.  These  decisions  should  be  made  by  the  parent  army,  at  least 
for  Red.  This  affects  the  timing  of  the  decisions  as  well  as  how  they  are 
implemented. 

d.  Artillery  Support.  Army-level  field  artillery  and  surf ace-to-sur- 
face  missiles  should  be  capable  of  being  assigned  in  support  of  subordinate 
corps.  This  cannot  be  done  at  present.  Incorporating  the  capability  would 
require  additions  to  both  the  C^  module  and  the  fire  support  module. 

J-3.  BEYOND  SCOPE  OF  CURRENT  FORCEM.  The  concepts  listed  here  cannot  be 
incorporated  into  FORCEM  without  major  overhaul  to  its  structure. 

a.  AirLand  Battle.  Some  of  the  aspects  of  AirLand  Battle  are  not 
portrayed  in  FORCEM;  e.g.,  deep  attack  by  ground  forces,  deep  attack  by 
airmobile  troops,  and  cutting  lines  of  communication. 

b.  Personnel  Issues.  FORCEM  does  not  consider  personnel  issues  such  as 
morale  and  leadership.  These  can  only  be  treated  implicitly  by  seeking 
division-level  combat  samples  with  various  levels  of  such  variables. 

c.  Time  in  Combat  and  Rate  of  Loss.  FORCEM  does  not  consider  the 
effect  of  time  in  combat,  or  rate  of  attrition  due  to  combat,  on  the 


J-l 
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results  of  combat.  Again,  the  only  hope  for  treating  these  concepts  in 
FORCEM  is  to  seek  division-level  combat  samples  for  various  levels  of  the 
variables.  If  such  samples  could  be  made  available,  then  it  would  be 
appropriate  to  install  perception  data  base  variables  for  the  variables 
(see,  e.g.,  Appendix  K,  paragraphs  K-2  through  K-5),  and  to  develop  logic 
for  the  FORCEM  C2  module  to  take  account  of  levels  associated  with  the 
perception  data  base  variables  (e.g.,  a  division  in  combat  for  a  “long" 
period  time  would  be  a  candidate  for  pulling  off-line). 

d.  Breakthrough.  A  breakthrough  can  occur,  but  the  attacker  does  not 
take  advantage  of  it  and  the  defender  does  not  attempt  to  compensate. 

There  is  no  logic  or  algorithm  for  dealing  with  the  situation  of  a  division 
being  in  the  enemy's  rear  where  combat  service  support  (CSS)  units  could 
easily  be  destroyed.  Nor  is  there  logic  for  the  defending  force  attempting 
to  shut  off  a  penetration  or  to  cut  the  lines  of  communication  of  the 
penetrator . 

e.  Weather.  The  only  consideration  of  weather  currently  is  day  versus 
night,  which  may  affect  the  selection  of  the  division  combat  sample  used  in 
assessing  division-level  combat  outcomes,  and  which  does  affect  the  numbers 
of  aircraft  sorties  (by  aircraft  type).  If  FORCEM  is  to  be  used  over  a 
time  period  covering  180  days,  then  the  effects  of  seasonal  weather  on 
combat  and  movement  ought  to  be  considered;  e.g.,  rainy  seasons,  sub-zero 
temperatures. 

f.  Overall  Consideration  of  Time.  FORCEM  takes  little  account  of  time. 
When  an  objective  is  set  for  a  division,  there  is  no  time  limit  associated 
with  reaching  the  objective.  Similarly,  when  the  control  phase  lines  of  a 
corps  are  moved,  there  is  no  time  limit  associated  with  first  echelon 
divisions  reaching  the  forward  control  phase  line.  At  the  army  level, 
there  is  the  capability,  not  yet  used,  to  transition  between  master  plans 
(and  hence  revise  the  army  objective  phase  line)  based  on  time  or  on  the 
geographical  locations  of  subordinate  online  corps';  however,  even  this 
logic  would  require  expansion  to  allow  for  revising  the  army  objective 
phase  line  based  on  a  combination  of  time  and  geographical  locations  (e.g., 
if  the  current  objective  phase  line  is  not  reached  by  a  specified  time, 
then  transition  to  a  new  master  plan  with  a  new  objective  phase  line). 

g.  Combat  Reserves.  FORCEM  should  have  greater  flexibility  in 
maintaining  combat  reserves.  At  the  corps  level,  the  current  approach  is 
satisfactory;  here  divisions  can  be  assigned  to  the  "second  echelon,"  and 
thus  be  ready  for  combat  but  not  committed.  At  higher  levels,  however,  the 
only  capability  of  this  sort  is  for  reserve  corps  within  an  army,  and  even 
here  a  reserve  corps  must  be  placed  behind  a  specific  online  corps  and  can 
only  be  committed  to  help  that  online  corps  or  one  of  its  two  immediate 
neighbors.  There  is  no  other  mechanism  for  maintaining  a  reserve  corps 
under  an  army  HQ.  Nor  are  there  mechanisms  for  an  army  HQ  maintaining  a 
reserve  division,  or  for  a  theater  HQ  maintaining  a  reserve  division  or 
corps  or  army.  Furthermore,  at  the  tneater  or  army  level,  there  is  no 
capability  for  reconstituting  a  reserve.  (See  also  paragraph  J-2b  above.) 
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h.  OPOROER  Methodology.  The  operations  order  (OPORDER)  methodology  in 
FORCEM  requires  considerable  expansion  to  allow  for  full  treatment  of  Red 
concepts.  The  OPOROER  for  a  corps  specified  by  the  parent  army  should 
designate  time  and  space  objectives  (see  paragraph  J-3f  above),  assigned 
echelon,  time  and  distance  for  commitment  (if  second  echelon),  whether  the 
corps  is  on  the  primary  or  secondary  axis  of  advance,  and  specified 
exchange  loss  rates.  Specifying  such  parameters  would  necessitate  addi¬ 
tional  logic  at  the  army  level  for  making  the  associated  decisions  and  for 
transitioning  to  new  OPORDERs  should  conditions  fail  to  be  met.  Similar 
comments  apply  to  an  army  OPORDER  specified  by  the  theater,  especially  for 
time  and  space  objectives,  assigned  echelon,  and  time  and  distance  for 
commitment.  There  are  rudimentary  capabilities  for  dealing  with  such  con¬ 
cepts  in  army-level  OPORDERs  through  user-defined  MASTER  PLANS,  but  they 
put  a  heavy  burden  on  the  user  and  require  iterative  executions  of  the 
model  to  obtain  realistic  outcomes. 
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APPENDIX  K 


ADDITIONAL  PERCEPTION  DATA  BASE  VARIABLES 


K-l.  INTRODUCTION.  In  their  written  comments,  the  subjects  in  the 
experiments  suggest  several  variables  for  use  as  decision  criteria  that  are 
not  currently  in  the  FORCEM  perception  data  base.  This  appendix  lists  such 
variables,  and  describes  how  they  might  be  computed  within  FORCEM.  Their 
incorporation  into  the  FORCEM  perception  data  base  would  make  them 
available  for  use  in  making  C2  decisions. 

K-2.  RATE  OF  LOSS  FOR  FRIENDLY  FORCES.  This  variable  would  apply  to  a 
corps  or  division.  The  value  could  be  absolute,  relative  to  current 
onhand,  or  relative  to  authorized.  The  value  could  be  computed  based  on 
losses  of  "onhand  combat  worth",  which  incorporates  the  input  "global 
importances"  of  onhand  combat  vehicles,  modified  by  the  availability  of 
personnel  to  crew  the  vehicles  and  by  the  availability  of  POL  and 
ammunition  for  use  by  the  vehicles. 

K-3.  RATE  OF  LOSS  FOR  ENEMY  FORCES.  This  variable  would  apply  to  a  corps 
or  division.  The  value  could  be  absolute,  relative  to  current  onhand,  or 
relative  to  authorized.  The  value  could  be  computed  based  on  losses  of 
"onhand  combat  worth"  to  opposing  enemy  divisions.  A  derivative  of  this 
variable  and  the  previous  variable  would  be  combat  momentum,  taken  as  the 
ratio  of  losses  of  enemy  forces  to  the  rate  of  losses  of  friendly  forces. 


K-4.  TIME  IN  SUSTAINED  COMBAT  FOR  FRIENDLY  FORCES. 

apply  to  a  corps  or  division. 


This  variable  would 


K-5.  TIME  IN  SUSTAINED  COMBAT  FOR  ENEMY  FORCES. 

to  a  corps  or  division. 


This  variable  would  apply 


K-6.  GEOGRAPHICAL  MOMENTUM.  This  variable  would  apply  to  a  corps  or 
division,  and  could  be  taken  as  the  rate  of  gain  or  loss  of  terrain. 

K-7.  PROJECTED  RATE  OF  MOVEMENT.  This  variable  would  apply  to  a  corps  or 
division,  and  would  consider  basic  movement  rates,  modified  by  terrain, 
congestion,  POL  shortage,  and  combat.  The  value  could  be  obtained  by 
smoothing  actual  movement  rates  of  recent  time  cycles,  modified  to  consider 
the  numbers  of  units  projected  to  be  in  the  area. 

K-8.  NUMBER  OF  DIVISION  THAT  CAN  BE  PLACED  IN  AREA.  This  variable  would 
apply  to  a  corps,  and  would  be  expressed  as  the  number  of  divisions  that 
can  be  placed  across  the  corps  front  considering  the  length  o''  the 
froi.tage,  the  type  of  terrain,  and  the  types  of  division^ . 
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1 

K-9.  STATUS  OF  ARTILLERY  SUPPORT.  This  variable  would  apply  to  a  corps  or 
division.  For  a  corps,  it  would  be  taken  as  the  number  of  corps-level 
(plus,  perhaps,  division-level)  artillery  tubes  available.  For  a  division, 
it  would  be  taken  as  the  number  of  division-level  (plus,  perhaps,  direct 
support  corps-level,  estimated  from  previous  time  cycles)  artillery  tubes 
available. 

K-10.  STATUS  OF  CLOSE  AIR  SUPPORT  (CAS).  This  variable  would  apply  to  a 
corps  or  division,  and  would  be  taken  as  the  ratio  of  the  number  of  CAS 
sorties  available  to  the  number  required  (the  latter  based  on  model 
inputs),  smoothed  over  recent  time  cycles. 

K-ll.  CONTROL  OF  AIR.  This  variable  would  apply  to  the  theater  HQ  (and 
possibly  an  army  HQ),  and  be  based  on  friendly  air  sorties  versus  enemy  a^r 
sorties,  by  air  role,  smoothed  over  recent  time  cycles. 

K-12.  ENEMY  POSTURE.  This  variable  would  apply  to  a  corps  or  division, 
and  be  measured  by  considering  enemy  divisions  in  the  area  and  determining 
their  direction  of  intended  movement  (either  by  examining  objectives  or  by 
smoothing  recent  movement). 
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APPENDIX  L 

EXPANDED  CRITERIA  FOR  DECISIONS 


L-l.  INTRODUCTION.  In  their  written  comments,  the  subjects  in  the  experi¬ 
ments  suggest  the  use  of  additional  decision  criteria  in  making  specific 
decisions.  This  appendix  lists  existing  perception  data  base  variables 
suggested  for  use  in  expanded  rules  for  existing  decisions  to  add  realism. 
The  format  here  is  decision,  followed  by  a  list  of  perception  data  base 
variables  to  be  used  as  decision  criteria  for  that  decision  over  and  above 
the  variables  used  in  the  rules  currently  in  FORCEM. 

L-2.  ASSIGNMENT  IF  NEW  FIELD  ARTILLERY  BATTALION 

a.  Posture  of  Potential  Receiving  Corps 

b.  Status  of  Divisional  Field  Artillery.  This  would  include  all  field 
artillery  in  divisions  subordinate  to  a  potential  receiving  corps. 

L-3.  DESIGNATION  OF  POSTURE  OF  ONLINE  CORPS 

a.  Terrain.  For  example,  mountainous  terrain  favors  defend  over  attack. 

b.  CSS  Status  of  Associated  Corps  Support  Complex 

c.  Information  on  Neighboring  Online  Corps.  This  would  include,  for 
example,  engagement  status,  location  relative  to  the  Army  objective  phase 
line,  force  ratio,  as  well  as  the  information  in  paragraphs  L-3a  and  L-3b 
above. 


L-4.  PRIORITY  TO  CORPS  (OR  DIVISION)  FOR  CAS 

a.  Posture  of  Corps  (or  Division) 

b.  Adequacy  of  Recent  CAS  Support.  Caution  must  be  exercised  in  using 
this  variable,  lest  high  priority  for  CAS  priority  "ping  pong"  among  corps' 
(or  divisions)  with  the  same  parent.  (See  also  Appendix  K,  paragraph  K-10.) 

L-5.  PRIORITY  TO  CORPS  (OR  DIVISION)  FOR  CSS 

a.  Posture  of  Corps  (or  Division) 

b.  Current  CSS  Status.  This  means  the  CSS  status  of  the  associated 
corps  support  complex  (or  of  the  division  and  the  associated  division  sup¬ 
port  complex).  Just  as  for  priority  for  CAS,  caution  must  be  exercised  in 
using  this  variable. 
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c.  Current  Fractional  Combat  Worth.  In  the  case  of  a  corps,  th.s  would 
be  accumulated  across  all  subordinate  divisions;  in  the  case  of  a  division, 
it  would  be  for  the  unit  itself.  Here  "combat  worth"  means  the  sum  of  the 
input  "global  importances"  of  onhand  combat  vehicles,  modified  by  the  avail 
ability  of  personnel  to  crew  the  vehicles  and  by  the  availability  of  POL 
and  ammunition  for  use  by  the  vehicles.  "Fractional  combat  worth"  means 
the  ratio  of  the  current  combat  worth  to  the  "authorized  combat  worth,"  the 
latter  being  the  sum  of  the  global  importances  of  the  authorized  combat 
vehicles. 
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1  i  .  ,  ■  -  . . 

THE  REASON  FDR  PERFORMING  THE  STUDY  is  to  validate  and  enhance  the  rules 
for  command  and  control  (C*)  decisionmaking  in  the  Force  Evaluation  Model 
(FORCEM).  FORCEM  is  a  fully  automated  computer  model  of  combat,  combat 
support,  and  combat  service  support  (CSS)  in  a  theater.  C?  is  treated 
through  a  set  of  decisions,  each  represented  through  embedded  rules  which 
in  turn  reference  preselected  information  from  the  perception  data  base. 

THE  PRINCIPAL  FINDINGS  OF  THE  STUDY  are: 

(1)  THe  approach  used  in  this  study  provides  a  valuable  tool  for  devel¬ 
oping  or  revising  decision  rules. 

(2)  The  perception  data  base  variables  used  in  the  rules  currently  in 
FORCEM  are  relevant  to  the  decisions. 

(3)  Several  additional  variables  are  suggested  for  incorporation  in  the 
FORCEM  perception  data  base,  for  possible  use  as  criteria  for  making 
decisions. 

(4)  For  several  decisions,  existing  perception  data  base  variables  are 
suggested  for  use  as  decision  criteria,  over  and  above  the  variables  used 
in  the  rules  currently  in  FORCEM. 

(5)  Oata  are  obtained  that  can  be  used  to  adjust  the  rules  currently  in 
FORCEM  to  better  reflect  the  views  of  the  subjects  queried  in  the  study. 

(6)  The  techniques  for  gathering  data  for  this  study  yield  starting 
points  for  methods  to  record  decision  processes  of  gamers  for  FORGE,  an 
interruptible  wargame  based  on  FORCEM.  Due  to  the  schedule  for  development 
of  FORGE,  and  the  constraint  on  time  for  this  study,  no  further  consider¬ 
ation  was  given  to  FORGE. 

THE  MAIN  ASSUMPTION  is  that  FORCEM  provides  an  adequate  context  for  examin- 
ing  issues  at  echelons  above  division. 

THE  PRINCIPAL  LIMITATION  is  that  the  study  is  limited  to  the  "Blue" 
perspective;  i.e.,  that  of  the  US  and  its  allies. 

THE  SCOPE  OF  THE  STUDY  is  the  following  set  of  decisions  from  the  FORCEM 
module: 

(1)  Assignment  of  new  corps. 

(2)  Assignment  of  new  division. 


(3)  Assignment  of  new  field  artillery  battalion. 

(4)  Designation  of  posture  of  online  corps. 

(5)  Specification  of  priority  to  corps  for  close  air  support  (CAS). 

(6)  Specification  of  priority  to  corps  for  CSS. 

(7)  Specification  of  priority  to  division  for  CAS. 

(8)  Specification  of  priority  to  division  for  CSS. 

THE  STUDY  OBJECTIVES  were  to: 

(1)  Develop  and  apply  methodologies  to: 

(a)  Examine  specific  decisions  using  scenarios  extracted  from  FORCEM 
or  FORGE,  including  selected  data  from  the  perception  data  base  and  graphics 
displays, 

(b)  Prepare  and  exercise  "offline"  experiments  based  on  the  scenarios, 
and 

(c)  Apply  the  information  collected  from  the  experiments  to  validate 
and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies  for 
use  during  the  actual  exercise  of  FORGE. 

(2)  Develop  methodologies  to: 

(a)  Record  gamer  decision  processes  during  the  exercise  of  FORGE,  and 

(b)  Use  the  information  collected  from  gamers  to  validate  and  enhance 
the  decision  rules  in  FORCEM. 

(3)  Make  recommendations  for  actual  exercises  of  FORGE. 

THE  BASIC  APPROACH  was  to  design  "offline"  experiments  based  on  the  selected 
decisions,  administer  the  experiments  to  groups  of  students  at  the  US  Army 
War  College,  and  apply  statistical  analysis  to  the  results  of  the  experi¬ 
ments.  Additional  information  was  collected  through  a  post-experiment 
questionnaire. 

THE  STUDY  SPONSOR  was  the  Director,  US  Army  Concepts  Analysis  Agency. 

THE  STUDY  EFFORT  was  directed  by  Dr.  James  J.  Metzger,  Forces  Directorate, 

US  Army  Concepts  Analysis  Agency. 

COMMENTS  AND  QUESTIONS  may  be  directed  to  the  Director,  US  Army  Concepts 
Analysis  Agency,  ATTN:  CSCA-FOF,  8120  Woodmont  Avenue,  Bethesda,  MD, 
20814-2797. 
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THE  REASON  FDR  PERFORMING  THE  STUDY  is  to  validate  and  enhance  the  rules 
for  command  and  control  (C^)  decisionmaking  in  the  Force  Evaluation  Model 
(FORCEM).  FORCEM  is  a  fully  automated  computer  model  of  combat,  combat 
support,  and  combat  service  support  (CSS)  in  a  theater.  is  treated 
through  a  set  of  decisions,  each  represented  through  embedded  rules  which 
in  turn  reference  preselected  information  from  the  perception  data  base. 

THE  PRINCIPAL  FINDINGS  OF  THE  STUDY  are: 

(1)  THe  approach  used  in  this  study  provides  a  valuable  tool  for  devel¬ 
oping  or  revising  decision  rules. 

(2)  The  perception  data  base  variables  used  in  the  rules  currently  in 
FORCEM  are  relevant  to  the  decisions. 

(3)  Several  additional  variables  are  suggested  for  incorporation  in  the 
FORCEM  perception  data  base,  for  possible  use  as  criteria  for  making 
decisions. 

(4)  For  several  decisions,  existing  perception  data  base  variables  are 
suggested  for  use  as  decision  criteria,  over  and  above  the  variables  used 
in  the  rules  currently  in  FORCEM. 

(5)  Data  are  obtained  that  can  be  used  to  adjust  the  rules  currently  in 
FORCEM  to  better  reflect  the  views  of  the  subjects  queried  in  the  study. 

(6)  The  techniques  for  gathering  data  for  this  study  yield  starting 
points  for  methods  to  record  decision  processes  of  gamers  for  FORGE,  an 
interruptible  wargame  based  on  FORCEM.  Due  to  the  schedule  for  development 
of  FORGE,  and  the  constraint  on  time  for  this  study,  no  further  consider¬ 
ation  was  given  to  FORGE. 

THE  MAIN  ASSUMPTION  is  that  FORCEM  provides  an  adequate  context  for  examin- 
ing  C^  issues  at  echelons  above  division. 

THE  PRINCIPAL  LIMITATION  is  that  the  study  is  limited  to  the  "Blue" 
perspective;  i.e.,  that  of  the  US  and  its  allies. 

THE  SCOPE  OF  THE  STUDY  is  the  following  set  of  decisions  from  the  FORCEM  C? 
module: 

(1)  Assignment  of  new  corps. 

(2)  Assignment  of  new  division. 


(3)  Assignment  of  new  field  artillery  battalion. 

(4)  Designation  of  posture  of  online  corps. 

(5)  Specification  of  priority  to  corps  for  close  air  support  (CAS). 

(6)  Specification  of  priority  to  corps  for  CSS. 

(7)  Specification  of  priority  to  division  for  CAS. 

(8)  Specification  of  priority  to  division  for  CSS. 

THE  STUDY  OBJECTIVES  were  to: 

(1)  Develop  and  apply  methodologies  to: 

(a)  Examine  specific  decisions  using  scenarios  extracted  from  FORCEM 
or  FORGE,  including  selected  data  from  the  perception  data  base  and  graphics 
displays, 

(b)  Prepare  and  exercise  "offline1'  experiments  based  on  the  scenarios, 
and 

(c)  Apply  the  information  collected  from  the  experiments  to  validate 
and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies  for 
use  during  the  actual  exercise  of  FORGE. 

(2)  Develop  methodologies  to: 

(a)  Record  gamer  decision  processes  during  the  exercise  of  FORGE,  and 

(b)  Use  the  information  collected  from  gamers  to  validate  and  enhance 
the  decision  rules  in  FORCEM. 

(3)  Make  recommendations  for  actual  exercises  of  FORGE. 

THE  BASIC  APPROACH  was  to  design  "offline"  experiments  based  on  the  selected 
decisions,  administer  the  experiments  to  groups  of  students  at  the  US  Army 
War  College,  and  apply  statistical  analysis  to  the  results  of  the  experi¬ 
ments.  Additional  information  was  collected  through  a  post-experiment 
questionnaire. 

THE  STUDY  SPONSOR  was  the  Oi rector,  US  Army  Concepts  Analysis  Agency. 

THE  STUDY  EFFORT  was  directed  by  Dr.  James  J.  Metzger,  Forces  Directorate, 

US  Army  Concepts  Analysis  Agency. 

CO WE NTS  AND  QUESTIONS  may  be  directed  to  the  Director,  US  Army  Concepts 
Analysis  Agency,  ATTN:  CSCA-FOF,  3120  Woodmont  Avenue,  Bethesda,  MD, 
20814-2797. 
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THE  REASON  FOR  PERFORMING  THE  STUDY  is  to  validate  and  enhance  the  rules 
for  command  and  control  (C*)  decisionmaking  in  the  Force  Evaluation  Model 
(FORCEM).  FORCEM  is  a  fully  automated  computer  model  of  combat,  combat 
support,  and  combat  service  support  (CSS)  in  a  theater.  C2  is  treated 
through  a  set  of  decisions,  each  represented  through  embedded  rules  which 
in  turn  reference  preselected  information  from  the  perception  data  base. 

THE  PRINCIPAL  FINDINGS  OF  THE  STUDY  are: 

(1)  THe  approach  used  in  this  study  provides  a  valuable  tool  for  devel¬ 
oping  or  revising  decision  rules. 

(2)  The  perception  data  base  variables  used  in  the  rules  currently  in 
FORCEM  are  relevant  to  the  decisions. 

(3)  Several  additional  variables  are  suggested  for  incorporation  in  the 
FORCEM  perception  data  base,  for  possible  use  as  criteria  for  making 
decisions. 

(4)  For  several  decisions,  existing  perception  data  base  variables  are 
suggested  for  use  as  decision  criteria,  over  and  above  the  variables  used 
in  the  rules  currently  in  FORCEM. 

(5)  Data  are  obtained  that  can  be  used  to  adjust  the  rules  currently  in 
FORCEM  to  better  reflect  the  views  of  the  subjects  queried  in  the  study. 

(6)  The  techniques  for  gathering  data  for  this  study  yield  starting 
points  for  methods  to  record  decision  processes  of  gamers  for. FORGE,  an 
interruptible  wargame  based  on  FORCEM.  Due  to  the  schedule  for  development 
of  FORGE,  and  the  constraint  on  time  for  this  study,  no  further  consider¬ 
ation  was  given  to  FORGE. 

THE  MAIN  ASSUMPTION  is  that  FORCEM  provides  an  adequate  context  for  examin- 
ing  issues  at  echelons  above  division. 

THE  PRINCIPAL  LIMITATION  is  that  the  study  is  limited  to  the  "Blue" 
perspective;  i.e.,  that  of  the  US  and  its  allies. 

THE  SCOPE  OF  THE  STUDY  is  the  following  set  of  decisions  from  the  FORCEM  C2 
modu 1 e : 


(1)  Assignment  of  new  corps. 

(2)  Assignment  of  new  division. 


(3)  Assignment  of  new  field  artillery  battalion. 

(4)  Designation  of  posture  of  online  corps. 

(5)  Specification  of  priority  to  corps  for  close  air  support  (CAS). 

(6)  Specification  of  priority  to  corps  for  CSS. 

(7)  Specification  of  priority  to  division  for  CAS. 

(8)  Specification  of  priority  to  division  for  CSS. 

THE  STUDY  OBJECTIVES  were  to: 

(1)  Develop  and  apply  methodologies  to: 

(a)  Examine  specific  decisions  using  scenarios  extracted  from  FORCEM 
or  FORGE,  including  selected  data  from  the  perception  data  base  and  graphics 
d i splays, 

(b)  Prepare  and  exercise  "offline"  experiments  based  on  the  scenarios, 
and 

(c)  Apply  the  information  collected  from  the  experiments  to  validate 
and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies  for 
use  during  the  actual  exercise  of  FORGE. 

(2)  Develop  methodologies  to: 

(a)  Record  gamer  decision  processes  during  the  exercise  of  FORGE,  and 

(b)  Use  the  information  collected  from  gamers  to  validate  and  enhance 
the  decision  rules  in  FORCEM. 

(3)  Make  recommendations  for  actual  exercises  of  FORGE. 

THE  BASIC  APPROACH  was  to  design  "offline"  experiments  based  on  the  selected 
decisions,  administer  the  experiments  to  groups  of  students  at  the  US  Army 
War  College,  and  apply  statistical  analysis  to  the  results  of  the  experi¬ 
ments.  Additional  information  was  collected  through  a  post-experiment 
questionnaire. 

THE  STUDY  SPONSOR  was  the  Director,  US  Army  Concepts  Analysis  Agency. 

THE  STUDY  EFFORT  was  directed  by  Dr.  James  J.  Metzger,  Forces  Directorate, 

US  Army  Concepts  Analysis  Agency. 

COWS NTS  AND  QUESTIONS  may  be  directed  to  the  Director,  US  Army  Concepts 
Analysis  Agency,  ATTN:  CSCA-FOF,  3120  Woodmont  Avenue,  3ethesda,  MD, 
20814-2797. 
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THE  REASON  FOR  PERFORMING  THE  STUDY  is  to  validate  and  enhance  the  rules 
for  command  and  control  (C^)  decisionmaking  in  the  Force  Evaluation  Model 
(FORCEM).  FORCEM  is  a  fully  automated  computer  model  of  combat,  combat 
support,  and  combat  service  support  (CSS)  in  a  theater.  C2  is  treated 
through  a  set  of  decisions,  each  represented  through  embedded  rules  which 
in  turn  reference  preselected  information  from  the  perception  data  base. 

THE  PRINCIPAL  FINDINGS  OF  THE  STUDY  are: 

(1)  ,  THe  approach  used  in  this  study  provides  a  valuable  tool  for  devel¬ 
oping  or  revising  decision  rules. 

(2)  The  perception  data  base  variables  used  in  the  rules  currently  in 
FORCEM  are  relevant  to  the  decisions. 

(3)  Several  additional  variables  are  suggested  for  incorporation  in  the 
FORCEM  perception  data  base,  for  possible  use  as  criteria  for  making 
decisions. 

(4)  For  several  decisions,  existing  perception  data  base  variables  are 
suggested  for  use  as  decision  criteria,  over  and  above  the  variables  used 
in  the  rules  currently  in-  FORCEM. 

(5)  Data  are  obtained  that  can  be  used  to  adjust  the  rules  currently  in 
FORCEM  to  better  reflect  the  views  of  the  subjects  queried  in  the  study. 

(6)  The  techniques  for  gathering  data  for  this  study  yield  starting 
points  for  methods  to  record  decision  processes  of  gamers  for  FORGE,  an 
interruptible  wargame  based  on  FORCEM.  Due  to  the  schedule  for  development 
of  FORGE,  and  the  constraint  on  time  for  this  study,  no  further  consider¬ 
ation  was  given  to  FORGE. 

THE  MAIN  ASSUMPTION  is  that  FORCEM  provides  an  adequate  context  for  examin- 
ing  issues  at  echelons  above  division. 

THE  PRINCIPAL  LIMITATION  is  that  the  study  is  limited  to  the  "Blue" 
perspective;  i.e.,  that  of  the  US  and  its  allies. 

THE  SCOPE  OF  THE  STUDY  is  the  following  set  of  decisions  from  the  FORCEM 
module: 


(1)  Assignment  of  new  corps. 

(2)  Assignment  of  new  division. 


(3)  Assignment  of  new  field  artillery  battalion. 

(4)  Designation  of  posture  of  online  corps. 

(5)  Specif ication  of  priority  to  corps  for  close  air  support  (CAS). 

(6)  Specification  of  priority  to  corps  for  CSS. 

(7)  Specification  of  priority  to  division  for  CAS. 

(8)  Specification  of  priority  to  division  for  CSS. 

THE  STUDY  OBJECTIVES  were  to: 

(1)  Develop  and  apply  methodologies  to: 

(a)  Examine  specific  decisions  using  scenarios  extracted  from  FORCEM 
or  FORGE,  including  selected  data  from  the  perception  data  base  and  graphics 
displays, 

(b)  Prepare  and  exercise  "offline"  experiments  based  on  the  scenarios, 
and 

(c)  Apply  the  information  collected  from  the  experiments  to  validate 
and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies  for 
use  during  the  actual  exercise  of  FORGE. 

(2)  Develop  methodologies  to: 

(a)  Record  gamer  decision  processes  during  the  exercise  of  FORGE,  and 

(b)  Use  the  information  collected  from  gamers  to  validate  and  enhance 
the  decision  rules  in  FORCEM. 

(3)  Make  recommendations  for  actual  exercises  of  FORGE. 

THE  BASIC  APPROACH  was  to  design  "offline"  experiments  based  on  the  selected 
decisions,  administer  the  experiments  to  groups  of  students  at  the  US  Army 
War  College,  and  apply  statistical  analysis  to  the  results  of  the  experi¬ 
ments.  Additional  information  was  collected  through  a  post-experiment 
questionnaire. 

THE  STUDY  SPONSOR  was  the  Director,  US  Army  Concepts  Analysis  Agency. 

THE  STUDY  EFFORT  was  directed  by  Dr.  James  J.  Metzger,  Forces  Directorate, 

US  Army  Concepts  Analysis  Agency. 

CQWIENTS  AND  QUESTIONS  may  be  directed  to  the  Director,  US  Army  Concepts 
Analysis  Agency,  ATTN:  CSCA-FOF,  3120  Woodmont  Avenue,  Sethesda,  MD, 
20814-2797. 
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THE  REASON  FOR  PERFORMING  THE  STUDY  is  to  validate  and  enhance  the  rules 
for  command  and  control  (C^)  decisionmaking  in  the  Force  Evaluation  Model 
(FORCEM).  FORCEM  is  a  fully  automated  computer  model  of  combat,  combat 
support,  and  combat  service  support  (CSS)  in  a  theater.  C?  is  treated 
through  a  set  of  decisions,  each  represented  through  embedded  rules  which 
in  turn  reference  preselected  information  from  the  perception  data  base. 

THE  PRINCIPAL  FINDINGS  OF  THE  STUDY  are: 

(1)  THe  approach  used  in  this  study  provides  a  valuable  tool  for  devel¬ 
oping  or  revising  decision  rules. 

(2)  The  perception  data  base  variables  used  in  the  rules  currently  in 
FORCEM  are  relevant  to  the  decisions. 

(3)  Several  additional  variables  are  suggested  for  incorporation  in  the 
FORCEM  perception  data  base,  for  possible  use  as  criteria  for  making 
decisions. 

(4)  For  several  decisions,  existing  perception  data  base  variaoles  are 
suggested  for  use  as  decision  criteria,  over  and  above  the  variab  es  used 
in  the  rules  currently  in  FORCEM. 

(5)  Data  are  obtained  that  can  be  used  to  adjust  the  rules  currently  in 
FORCEM  to  better  reflect  the  views  of  the  subjects  queried  in  the  study. 

(6)  The  techniques  for  gathering  data  for  this  study  yield  starting 
points  for  methods  to  record  decision  processes  of  gamers  for  FORGE,  an 
interruptible  war game  based  cn  FORCEM.  Due  to  the  schedule  for  development 
of  FORGE,  and  the  constraint  on  time  for  this  study,  no  further  consider¬ 
ation  was  given  to  FORGE. 

THF  MAIN  ASSUMPTION  is  that  FORCEM  provides  an  adequate  context  for  examin- 
ing  C^  issues  at  echelons  above  division. 

THE  PRINCIPAL  LIMITATION  is  that  the  study  is  limited  to  the  "Blue" 
perspective;  i.e.,  that  of  the  UC  and  its  allies. 

THE  SCORE  OF  THE  STUDY  is  the  following  set  of  decisions  from  the  FORCEM 
module: 


(1)  Assignment  of  new  co^ps. 

(2)  Assignment  of  new  division. 


(3)  Assignment  of  new  field  artillery  battalion. 

(4)  Designation  of  posture  of  online  corps. 

(5)  Specification  of  priority  to  corps  for  close  air  support  (CAS). 

(6)  Specification  of  priority  to  corps  for  CSS. 

(7)  Specification  of  priority  to  division  for  CAS. 

(8)  Specification  of  priority  to  division  for  CSS. 

THE  STUDY  OBJECTIVES  were  to: 

(1)  Develop  and  apply  methodologies  to: 

(a)  Examine  specific  decisions  using  scenarios  extracted  from  FORCEM 
or  FORGE,  including  selected  data  from  the  perception  data  base  and  graphics 
displays, 

(b)  Prepare  and  exercise  "offline"  experiments  based  on  the  scenarios, 
and 

(c)  Apply  the  information  collected  from  the  experiments  to  validate 
and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies  for 
use  during  the  actual  exercise  of  FORGE. 

(2)  Develop  methodologies  to: 

(a)  Record  gamer  decision  processes  during  the  exercise  of  FORGE,  and 

(b)  Use  the  information  collected  from  gamers  to  validate  and  enhance 
the  decision  rules  in  FORCEM. 

(3)  Make  recommendations  for  actual  exercises  of  FORGE. 

THE  BASIC  APPROACH  was  to  design  "offline"  experiments  based  on  the  selected 
decisions,  administer  the  experiments  to  groups  of  students  at  the  US  Army 
War  College,  and  apply  statistical  analysis  to  the  results  of  the  experi¬ 
ments.  Additional  information  was  collected  through  a  post-experiment 
questionnaire. 

THE  STUDY  SPONSOR  was  the  Director,  US  Army  Concepts  Analysis  Agency. 

THE  STUDY  EFFORT  was  directed  by  Dr.  James  J.  Metzger,  Forces  Directorate, 

US  Army  Concepts  Analysis  Agency. 

CQWENTS  AND  QUESTIONS  may  be  directed  to  the  Director,  US  Army  Concepts 
Analysis  Agency,  ATTN:  CSCA-FOF,  3120  Woodmont  Avenue,  3ethesda,  MD, 
20814-2797. 
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THE  REASON  FOR  PERFORMING  THE  STUDY  is  to  validate  and  enhance  the  rules 
for  command  and  control  (C^)  decisionmaking  in  the  Force  Evaluation  Model 
(FORCEM).  FORCEM  is  a  fully  automated  computer  model  of  combat,  combat 
support,  and  combat  service  support  (CSS)  in  a  theater.  C2  is  treated 
through  a  set  of  decisions,  each  represented  through  embedded  rules  which 
in  turn  reference  preselected  information  from  the  perception  data  base. 

THE  PRINCIPAL  FINDINGS  OF  THE  STUDY  are: 

(1)  THe  approach  used  in  this  study  provides  a  valuable  tool  for  devel¬ 
oping  or  revising  decision  rules. 

(2)  The  perception  data  base  variables  used  in  the  rules  currently  in 
FORCEM  are  relevant  to  the  decisions. 

(3)  Several  additional  variables  are  suggested  for  incorporation  in  the 
FORCEM  perception  data  base,  for  possible  use  as  criteria  for  making 
decisions. 

(4)  For  several  decisions,  existing  perception  data  base  variables  are 
suggested  for  use  as  decision  criteria,  over  and  above  the  variables  used 
in  the  rules  currently  in  FORCEM. 

(5)  Data  are  obtained  that  can  be  used  to  adjust  the  rules  currently  in 
FORCEM  to  better  reflect  the  views  of  the  subjects  queried  in  the  study. 

.  (6)  The  techniques  for  gathering  data  for  this  study  yield  starting 

points  for  methods  to  record  decision  processes  of  gamers  for  FORGE,  an 
interruptible  wargame  based  on  FORCEM.  Due  to  the  schedule  for  development 
of  FORGE,  and  the  constraint  on  time  for  this  study,  no  further  consider¬ 
ation  was  given  to  FORGE. 

THE  MAIN  ASSUMPTION  is  that  FORCEM  provides  an  adequate  context  for  examin- 
ing  C^  issues  at  echelons  above  division. 

THE  PRINCIPAL  LIMITATION  is  that  the  study  is  limited  to  the  "Blue" 
perspective;  i.e.,  that  of  the  US  and  its  allies. 

THE  SCOPE  OF  THE  STUDY  is  the  following  set  of  decisions  from  the  FORCEM  C^ 
module: 


(1)  Assignment  of  new  corps. 

(2)  Assignmen  )f  new  division. 


(3)  Assignment  of  new  field  artillery  battalion. 

(4)  Designation  of  posture  of  online  corps. 

(5)  Specification  of  priority  to  corps  for  close  air  support  (CAS). 

(6)  Specification  of  priority  to  corps  for  CSS. 

(7)  Specification  of  priority  to  division  for  CAS. 

(8)  Specification  of  priority  to  division  for  CSS. 

THE  STUDY  OBJECTIVES  were  to: 

(1)  Develop  and  apply  methodologies  to: 

(a)  Examine  specific  decisions  using  scenarios  extracted  from  FORCEM 
or  FORGE,  including  selected  data  from  the  perception  data  base  and  graphics 
displays, 

(b)  Prepare  and  exercise  "offline"  experiments  based  on  the  scenarios, 
and 

(c)  Apply  the  information  collected  from  the  experiments  to  validate 
and  enhance  the  decision  rules  in  FORCEM,  and  to  design  methodologies  for 
use  during  the  actual  exercise  of  FORGE. 

(2)  Develop  methodologies  to: 

(a)  Record  gamer  decision  processes  during  the  exercise  of  FORGE,  and 

(b)  Use  the  information  collected  from  gamers  to  validate  and  enhance 
the  decision  rules  in  FORCEM. 

(3)  Make  recommendations  for  actual  exercises  of  FORGE. 

THE  BASIC  APPROACH  was  to  design  "offline"  experiments  based  on  the  selected 
decisions,  administer  the  experiments  to  groups  of  students  at  the  US  Army 
War  College,  and  apply  statistical  analysis  to  the  results  of  the  experi¬ 
ments.  Additional  information  was  collected  through  a  post-experiment 
questionnaire. 

THE  STUDY  SPONSOR  was  the  Director,  US  Army  Concepts  Analysis  Agency. 

THE  STUDY  EFFORT  was  directed  by  Dr.  James  J.  Metzger,  Forces  Directorate, 

US  Army  Concepts  Analysis  Agency. 

COWENTS  AND  QUESTIONS  may  be  directed  to  the  Director,  US  Army  Concepts 
Analysis  Agency,  ATTN:  CSCA-FOF,  8120  Woodmont  Avenue,  Bethesda,  MD, 
20814-2797. 


